Localizing transportation requests utilizing an image based transportation request interface

ABSTRACT

The present application discloses an improved transportation matching system, and corresponding methods and computer-readable media. According to the disclosed embodiments, the transportation matching system utilizes an image-based transportation request interface and environmental digital image stream to efficiently generate transportation requests with accurate pickup locations. For instance, the disclosed system can utilize one or more environmental digital images provided from a requestor computing device (e.g., a mobile device or an augmented reality wearable device) to determine information such as the location of the requestor computing device and a transportation pickup location within the environmental digital images. Furthermore, the disclosed system can provide, for display on the requestor computing device, one or more augmented reality elements at the transportation pickup location within an environmental scene that includes the transportation pickup location.

BACKGROUND

The utilization of mobile app-based transportation systems has grownsignificantly in recent years. Through such transportation systems, arequestor computing device can generate and send a transportationrequest to a remote server across a computer network. The system canthen match the transportation request to a provider computing deviceassociated with a transportation provider, transmitting a pickuplocation and destination location to the provider computing device. Inthis manner, transportation systems can utilize computer networks toalign requestor computing devices and transportation computing devicesin providing transportation services.

Although conventional systems are able to utilize computer networks toconnect requestor and provider computing devices, they suffer from anumber of disadvantages, particularly in relation to accuracy andefficiency of implementing computing systems. For instance, the use ofmobile applications often results in inaccuracies in identifying andtransmitting pickup locations for requestor devices. To illustrate, someconventional systems have requestors provide user input of a pickuplocation at a requestor device (e.g., via a digital map). This approachoften results in inaccurate pickup locations, as requestors cannotaccurately identify their surrounding environment while initiating atransportation request (e.g., cannot accurately identify the surroundingenvironment on a digital map due to limited visibility, due tounfamiliar and/or foreign surroundings during travel, or due tounfamiliarity with traffic laws related to transportation requests).

Some transportation systems seek to remedy this deficiency by utilizingGPS to identify a requestor and pickup location. However, in manyinstances, conventional systems that utilize GPS on a requestorcomputing device fail to accurately locate the requestor computingdevice. For example, urban areas often include urban canyons whereline-of-site to satellite systems is interrupted, making GPS signalsunreliable and inaccurate. Additionally, some conventionaltransportation systems may use GPS to locate the general location of therequestor computing device, but fail to determine an accurate pickuplocation with the precision needed for a provider computing device(e.g., determining that the requestor is on the opposite side of thestreet from where the pickup location is set).

Even where conventional systems identify an accurate pickup location,conventional systems often provide that position within a user interfacethat makes it difficult, time-consuming, and inefficient to accuratelyand safely navigate to the pickup location. For example, conventionalsystems often provide a pickup location on a user interface thatincludes a top-down map. For requestors that are unfamiliar with aparticular region, this user interface can require excessive time anduser interaction to identify the location of the pickup location in thereal-world environment. Indeed, conventional systems often requireexcessive time and user interactions as requestors zoom, pan, orphysically rotate the computing device in an effort to translate thepickup location portrayed in the user interface to the real-worldenvironment.

In addition to these problems, conventional systems also suffer fromoperational inefficiencies. Indeed, conventional systems often wastetime and computational resources in identifying a pickup location for arequestor device. For example, as discussed above, conventional systemsengage in numerous communications in identifying pickup location, suchas communications with GPS systems or transmitting locations selectedvia a digital map. In addition to the computational resources requiredto manage these processes, conventional systems also carry the overheadof additional duplicative communications between requestor devices andtransportation devices when a pickup location is inaccurate. Toillustrate, upon identifying and transmitting inaccurate pickuplocations, conventional systems must facilitate and transmit multipleadditional communications between requestor devices and provider devicesover time (e.g., when the requestor and/or transportation providercannot locate each other and/or the determined pickup location).Accordingly, identifying an accurate pickup location is among the mosttime consuming and computationally expensive processes of conventionaltransportation systems.

Thus, there are several disadvantages with regard to conventionaldigital transportation systems.

SUMMARY

One or more embodiments of the present disclosure provide benefitsand/or solve one or more of the foregoing or other problems in the artwith methods, systems, and non-transitory computer readable storagemedia that utilize an image-based transportation request interface andenvironmental digital image stream to efficiently establishtransportation requests between requestor and provider computing deviceswith accurate pickup locations. For example, the disclosed systems cangenerate a ride-sharing experience across computer networks without theinaccuracies and inefficiencies of conventional approaches that usedigital maps (e.g., GPS map locations or user-generated positionselections). Specifically, the disclosed systems can compare anenvironmental digital image stream from a requestor computing devicewith known digital images of known geographic locations to identify aposition of the requestor device. The disclosed systems can then selectand provide a pickup location within the environmental scene. Forexample, the disclosed systems can generate an augmented reality elementand provide the augmented reality element in the environmental digitalimage stream of the requestor device. In this manner, the disclosedsystems can accurately and efficiently identify requestor devicelocations and communicate corresponding pickup locations to requestorand/or provider computing devices.

To illustrate, in one or more embodiments, the disclosed systems cause arequestor computing device to capture an environmental digital imagestream utilizing a camera of the requestor computing device (e.g., whena requestor begins a transportation request on the requestor computingdevice). Furthermore, in some embodiments, the disclosed systemsdetermine a location of the camera based on the captured environmentaldigital image stream. Moreover, in one or more embodiments, thedisclosed systems determine at least one transportation pickup locationbased at least in part on the location of the camera. Then, thedisclosed systems can utilize the at least one transportation pickuplocation (and/or other information related to the transportationrequest) to provide, for display on the requestor computing device, anaugmented reality element at the at least one transportation pickuplocation within an environmental scene (e.g., on a display screen of amobile device and/or on a lens of an augmented reality wearable device).

Additional features and advantages of one or more embodiments of thepresent disclosure are outlined in the description which follows, and inpart will be obvious from the description, or may be learned by thepractice of such example embodiments.

BRIEF DESCRIPTION OF THE DRAWINGS

The detailed description is described with reference to the accompanyingdrawings in which:

FIG. 1 illustrates a diagram of an environment in which a transportationmatching system can operate in accordance with one or more embodiments.

FIG. 2 illustrates an overview of the transportation matching systemdetermining and displaying a transportation pickup location inaccordance with one or more embodiments.

FIG. 3 illustrates a flowchart of the transportation matching systemcapturing an environmental digital image stream in accordance with oneor more embodiments.

FIG. 4 illustrates a flowchart of the transportation matching systemdetermining a transportation pickup location in accordance with one ormore embodiments.

FIGS. 5A and 5B illustrate the transportation matching system displayingan augmented reality element within an environmental scene at atransportation pickup location in accordance with one or moreembodiments.

FIG. 6 illustrates the transportation matching system displayingmultiple augmented reality elements within an environmental scene atmultiple transportation pickup locations in accordance with one or moreembodiments.

FIG. 7 illustrates the transportation matching system displaying anaugmented reality directional element within an environmental scene inaccordance with one or more embodiments.

FIG. 8 illustrates a flowchart of the transportation matching systemutilizing location tracking of a requestor computing device to send atransportation request to a transportation provider in accordance withone or more embodiments.

FIG. 9 illustrates the transportation matching system displaying anaugmented reality element within an environmental scene on atransportation provider computing device in accordance with one or moreembodiments.

FIG. 10 illustrates the transportation matching system displaying anaugmented reality element indicating a transportation provider within anenvironmental scene in accordance with one or more embodiments.

FIG. 11 illustrates a schematic diagram of the transportation matchingsystem in accordance with one or more embodiments.

FIG. 12 illustrates a flowchart of a series of acts for providingtransportation pickup location information by utilizing an environmentaldigital image stream in accordance with one or more embodiments.

FIG. 13 illustrates a block diagram of an example computing device inaccordance with one or more embodiments.

FIG. 14 illustrates an example network environment of a transportationmatching system in accordance with one or more embodiments.

DETAILED DESCRIPTION

One or more embodiments described herein provide benefits and solve oneor more of the foregoing or other problems in the art with atransportation matching system that utilizes an image-basedtransportation request interface and environmental digital image streamto efficiently generate and provide pickup locations for requestorcomputing devices. In particular, in one or more embodiments, thetransportation matching system utilizes an environmental digital imagestream from a requesting device together with SLAM technology anddigital images of known locations to determine an accurate location of arequesting device. In one or more embodiments, the transportationmatching system further generates a pickup location augmented realityelement (based on the location of the requesting device). By utilizingan augmented reality element, the transportation matching system candisplay the pickup location within an environmental scene (e.g., withouta top-down digital map). In this manner, the transportation matchingsystem can accurately and efficiently determine and provide pickuplocations to requestor and/or provider computing devices.

As just mentioned, in one or more embodiments, the transportationmatching system, captures an environmental digital image streamutilizing a camera of the requestor computing device. For example,instead of opening a map interface, the transportation matching systemcan identify that a requestor seeks to initiate a transportation requestand cause the requestor computing device to capture an environmentaldigital image stream. Specifically, in one or more embodiments, thetransportation matching system causes the requestor computing device(e.g., a mobile device) to capture an environmental digital image streamand display the digital image stream on the requestor computing devicewith instructions to capture the requestor's surrounding environment.

Upon capturing an environmental digital image stream, in one or moreembodiments, the transportation matching system determines a requestorlocation based on an environmental digital image from the environmentaldigital image stream. For example, as described in greater detail below,the transportation matching system can utilize a SLAM approach todetermine a location of a requestor computing device based onenvironmental digital images from the requestor computing device. Forinstance, the transportation matching system can utilize a SLAM approachto generate a three-dimensional representation from the digital imagestream. The transportation matching system can compare thethree-dimensional representation to known representations of variouslocations (generated from previously captured digital images) todetermine the location of the requestor computing device.

Using the location of the requestor computing device, the transportationmatching system can determine possible pickup locations (e.g., based onavailable provider computing devices and locations that transportationproviders and requestors can converge). Furthermore, the transportationmatching system can also determine other information such as, but notlimited to, available transportation providers, costs, and/or anestimated time of arrival based on the determined location. Thetransportation matching system can also provide such information to therequestor computing device.

Upon determining the transportation pickup location based on theenvironmental digital image, the transportation matching system can alsoprovide, for display on the requestor computing device, an augmentedreality element at the transportation pickup location (e.g., within anenvironmental scene that includes the transportation pickup location).For instance, in some embodiments, the transportation matching systemcreates an augmented reality element that displays an indicator withinthe environmental scene (e.g., the scene that is being captured on therequestor computing device) where the transportation pickup location islocated. Accordingly, the transportation matching system can provide theaugmented reality element in a map-less interface to indicate the pickuplocation.

The transportation matching system can also create augmented realitydirectional elements that display a path to the transportation pickuplocation and/or information such as a cost and/or estimated time ofarrival for a transportation request. In some embodiments, thetransportation matching system can display the one or more augmentedreality elements on one or more lenses of an augmented reality wearabledevice that is viewing the environmental scene (e.g., augmented realityglasses).

The transportation matching system can also monitor and update thelocation of the requestor computing device (e.g., as the requestorcomputing device moves toward a pickup location). Indeed, thetransportation matching system can continue capturing digital images toidentify updated requestor positions. In some embodiments, thetransportation matching system utilizes dead reckoning approaches todetermine relative movement of the requestor computing device from aninitial location. For instance, the transportation matching system canutilize inertial measurement unit (“IMU”), directional, and/or velocitysensors to determine relative movement from an initial position (e.g.,to determine when a requestor has reached a pickup location).

Furthermore, the transportation matching system can send atransportation request to a transportation provider device. Indeed, thetransportation matching system can send a transportation request inresponse to detecting various events at the requestor device. Forinstance, upon detecting that the requestor is moving towards thetransportation pickup location the transportation matching system cansend a transportation request. Similarly, the transportation matchingsystem can send a transportation request upon detecting interactions bythe requestor with one or more augmented reality elements within theenvironmental scene, detecting that the requestor has arrived at apickup location, or upon detecting another user interaction.

The disclosed transportation matching system provides several advantagesover conventional systems. For example, the transportation matchingsystem can determine a transportation pickup location with improvedaccuracy relative to conventional transportation systems. For instance,by utilizing an environmental digital image stream portraying arequestor's surrounding environment, the transportation matching systemcan accurately determine the location of the requestor computing device.For example, the transportation matching system can determine a specificside of the street and a particular location along a street, even inurban areas where urban canyons interfere with conventional GPSimplementations. Additionally, the transportation matching system canalso utilize the environmental digital image stream to determine a moreaccurate orientation of the requestor (e.g., which direction therequestor is facing) and utilize this information to provide moreaccurate information associated with the transportation request.

In addition to these accuracy improvements, the transportation matchingsystem also improves efficiency by providing an image-basedtransportation request interface. For instance, by providing a userinterface that utilizes an environmental digital image stream todetermine a pickup location, the requestor can identify and/or verifytheir location when the requestor is unfamiliar with their currentsurrounding environment. Additionally, by utilizing augmented realityelements to indicate a transportation pickup location within atransportation service mobile-app, the transportation matching systemreduces time and user interactions required to locate a transportationpickup location and/or other information associated with thetransportation request. Indeed, in some embodiments, the transportationmatching system enables a requestor to locate a transportation pickuplocation without having to use a map.

Additionally, the transportation matching system more efficientlyutilizes computer resources in comparison to some conventionaltransportation systems. For instance, by providing a more accuratetransportation pickup location, the transportation matching systemutilizes less computer resources to facilitate communications betweenthe transportation providers and requestors. Indeed, by enablingrequestors and/or transportation providers to accurately locate atransportation pickup location via augmented reality elements, thetransportation matching system can cause fewer errors, reducecommunications (e.g., reduce GPS communications and calculations), andfacilitate transportation requests with more efficiency and speed.

As illustrated by the foregoing discussion, the present disclosureutilizes a variety of terms to describe features and advantages of thetransportation matching system. For reference, additional detail is nowprovided regarding the use of these terms. For example, as used herein,the term “transportation request” (sometimes referred to as“transportation service request”) refers to a request configured by arequestor for transportation provided by a transportation provider. Inparticular, the term “transportation request” can include a requestconfigured by a requestor computing device that includes a destinationlocation and/or a pickup location, for transportation between thoselocations by a transportation provider. For example, a transportationrequest includes a request that is configured within a transportationservice mobile-app for transportation services from a pickup location toa destination location.

Furthermore, as used herein, the term “initiate a transportationrequest” can include any action and/or interaction that indicates that arequestor is configuring and/or seeking a transportation provider toprovide a transportation service. For example, initiating atransportation request can include selection of an option within aninterface to request a transportation service, opening a transportationservice mobile-app on a requestor computing device, and/or configuring atransportation request on a transportation service mobile-app. Uponcompleting a transportation request (e.g., finalizing information suchas pickup location, ride-type, vehicle type, etc.), the transportationmatching system can send a transportation request to a transportationprovider computing device.

In addition, as used herein, the term “requestor computing device” (orsometimes referred to as “client device” or “requestor device”) refersto a computing device associated with a requestor (e.g., a person whorequests transportation services). In particular, a requestor computingdevice can include a computing device associated with a requestor thatis capable of initiating a transportation request via a requestorapplication (e.g., a transportation service mobile-app). For example, arequestor computing device can include mobile devices such as, but notlimited to a laptop, smartphone, or tablet and/or an augmented realitywearable device. Moreover, as used herein, the term “augmented realitywearable device” refers to a device capable of overlaying (ordisplaying) digital items (or augmented reality elements) into areal-world view and/or scene (e.g., an environmental scene). Forexample, an augmented reality device can include augmented realityglasses.

As used herein, the term “environmental digital image stream” (orsometimes referred to as “digital image stream”) refers to one or moredigital images that portray an environment. In particular, the term“environmental digital image stream” can include a plurality of digitalimages captured on a camera that portrays a live environmental scene(e.g., the environment that is within the vantage point of a camera).For example, an environmental digital image stream can include a videocaptured on a camera of a requestor computing device that captures theenvironment in which the requestor is positioned (e.g., a video stream,a live camera feed, etc.).

As used herein, the term “environmental digital image” (or sometimesreferred to as “digital image”) refers to a single frame (or image)captured from an environmental digital image stream. In particular, theterm “environmental digital image” refers to an image, from anenvironmental digital image stream, that portrays and/or depicts anenvironmental scene in which the requestor is positioned. For instance,an environmental digital image can include, but is not limited to, adigital file with the following file extensions: JPG, TIFF, BMP, PNG,RAW, or PDF.

Moreover, as used herein, the term “environmental scene” (sometimesreferred to as “environment scene”) refers to an area corresponding to arequestor. In particular, the term “environmental scene” refers to anarea, such as the immediate surrounding environment of a requestor whenconfiguring a transportation request, that is capable of being viewed bythe requestor and/or a camera of a requestor computing device. Forinstance, an environmental scene includes a street on which a requestoris located while configuring a transportation request from the requestorcomputing device (e.g., identifying a pickup location on the requestorcomputing device via an environmental digital image stream).

As used herein, the term “augmented reality element” refers to a visualelement that overlays (or is within) an environmental scene. Inparticular, the term “augmented reality element” refers to a visualelement (e.g., a digital image, digital graphic, digital video, etc.)that overlays (or is within) an environmental scene portrayed within adisplay that is capturing an environmental digital image stream and/oron a transparent medium that is facing the environmental scene (e.g.,augmented reality glasses). For example, an augmented reality elementincludes a digital image corresponding to a transportation pickuplocation that is displayed within an environmental scene by overlayingthe digital image within a display of an environmental digital imagestream and/or on a transparent medium facing the environmental scene.

As used herein, the term “local movement information” refers to digitaldata reflecting movement of a device. For example, local movementinformation includes data from a step counter, IMU, accelerometer,changes in GPS on the requestor device, and/or changes in other signalssuch as, but not limited to, Bluetooth and WiFi. As outlined in greaterdetail below, the transportation matching system can utilize localmovement information of a requestor computing device as part of a deadreckoning method to track intermediate locations of a requestorcomputing device (e.g., after determining a camera position based on adigital image stream).

Turning now to the figures, FIG. 1 illustrates an example environment100 in which a transportation matching system 104 is implemented. Asshown, the environment 100 includes requestor computing devices 108a-108 n (sometimes referred to as simply “requestor computing devices108”) associated with requestors 110 a-110 n (sometimes referred to assimply “requestors 110”) and a transportation provider computing device112. As shown in FIG. 1, the transportation matching system 104 can beimplemented on server device(s) 102. As further shown in FIG. 1, therequestor computing devices 108 and the transportation providercomputing device 112 communicate with the transportation matching system104 and/or each other via a network 106. Additional detail regarding thenetwork 106 will be provided below in relation to FIGS. 13-14.

Although FIG. 1 illustrates the server device(s) 102, the requestorcomputing devices 108, and the transportation provider computing device112 communicating via the network 106, the various components of theenvironment 100 can communicate and/or interact via other methods (e.g.,the server device(s) 102 and the requestor computing devices 108 cancommunicate directly). Furthermore, although FIG. 1 illustrates thetransportation matching system 104 being implemented by a particularcomponent and/or device within the environment 100, the transportationmatching system 104 can be implemented, in whole or in part, by othercomputing devices and/or components in the environment 100. Moreover,the server device(s) 102, the network 106, the requestor computingdevices 108, and/or the transportation provider computing device 112 caninclude a variety of types of computing devices, including thoseexplained below with reference to FIGS. 13 and 14.

As shown in FIG. 1, the server device(s) 102 can include thetransportation matching system 104. In particular, the transportationmatching system 104, as discussed in more detail below, can determinetransportation pickup locations for requestor computing devices 108based on environmental digital images and match transportation requestsreceived from requestor computing devices 108 to a transportationprovider (or transportation provider computing device 112). Furthermore,as discussed in more detail below, the transportation matching system104 can provide augmented reality elements for display on requestorcomputing devices (and/or provider computing devices) to indicatetransportation pickup locations in response to transportation requests.

Furthermore, each of the requestor computing devices 108 a-108 n and thetransportation provider computing device 112 can include computingdevices, such as, but not limited to mobile computing devices (e.g., amobile phone), a tablet, augmented reality devices (e.g., a wearableaugmented reality device such as augmented reality glasses), and/orvehicle computing devices. Additionally, each of the requestor computingdevices 108 a-108 n and the transportation provider computing device 112include transportation matching system applications (e.g., a mobile-appbased transportation service application). Although FIG. 1 illustrates acertain number of requestor computing devices 108, transportationprovider computing devices 112, and/or other components, the environment100 can include any number of requestor computing devices 108,transportation provider computing devices 112, and/or other componentsof the environment 100.

For instance, the transportation matching system applications enable therequestors associated with the requestor computing devices 108 a-108 nand the transportation provider computing device 112 to interact withfeatures of the transportation matching system 104. For instance, therequestor computing devices 108 can initiate transportation matchingsystem application sessions, configure and/or send transportationrequests, capture environmental digital image streams, and/or sendenvironmental digital images to the transportation matching system 104.Furthermore, as discussed in greater detail below, the requestorcomputing devices 108 can receive information such as a transportationpickup location (based on environmental digital images) from thetransportation matching system 104 and can also display augmentedreality elements at the transportation pickup location in anenvironmental scene including the transportation pickup location.Moreover, the transportation provider computing device 112 can receive atransportation request and/or fulfill a transportation request using atransportation matching system application. In one or more embodiments,the transportation matching system application on the requestorcomputing devices 108 include features specific to requestors, whiletransportation matching system application on transportation providercomputing device 112 include features specific to transportationproviders.

As mentioned above, the transportation matching system 104 can determinea transportation pickup location based on environmental digital imagescaptured on a requestor computing device and cause the requestorcomputing device to display augmented reality elements at thetransportation pickup location. For instance, FIG. 2 illustrates anoverview of a sequence of acts that the transportation matching system104 performs in relation to capturing an environmental digital imagestream, determining a transportation pickup location based on anenvironmental digital image, and displaying augmented reality elementsfor the transportation pickup location on a requestor computing device.As mentioned, the acts performed by the transportation matching system104 can be implemented by a variety of components (e.g., the serverdevice(s) 102, the requestor computing devices 108, and/or thetransportation provider computing devices 112).

For example, as shown in FIG. 2, the transportation matching system 104performs an act 202 of capturing an environmental digital image streamfor a transportation request on a requestor computing device. Forinstance, the transportation matching system 104 can receive anindication to initiate a transportation request from a requestorcomputing device and, in response, cause the requestor computing deviceto capture an environmental digital image stream to determine atransportation pickup location. Indeed, the transportation matchingsystem 104 can provide instructions to share the requestors environmentwhile capturing the environmental digital image stream. Additionaldetail regarding the transportation matching system 104 capturing anenvironmental digital image stream on a requestor computing device isdescribed in greater detail in FIG. 3.

Furthermore, as illustrated in FIG. 2, the transportation matchingsystem 104 performs an act 204 of determining a transportation pickuplocation based on an environmental digital image. For instance, thetransportation matching system 104 can cause the requestor computingdevice to provide one or more environmental digital images from theenvironmental digital image stream to a remote server (e.g., the serverdevice(s) 102). Furthermore, the transportation matching system 104 cananalyze the one or more environmental digital images to determineinformation such as, but not limited to, a location of the requestorcomputing device, information regarding a transportation pickuplocation, information regarding an identified transportation provider,information regarding the transportation request, and/or informationregarding the completion of the transportation request. Additionally,the transportation matching system 104 can provide such informationdetermined from the one or more environmental digital images to therequestor computing device.

For example, the transportation matching system 104 can analyze aplurality of environmental digital images from an environmental digitalstream and compare the environmental digital images to previouslycaptured (known) digital images of various locations to determine thelocation of the requestor computing device. By comparing theenvironmental digital images captured by the requestor device and knowndigital images of various locations, the transportation matching system104 can determine a precise location of the requestor. To illustrate, insome embodiments the transportation matching system 104 utilizes theenvironmental digital images to generate a representation of theenvironment surrounding a requestor computing device (e.g., utilizingSLAM approaches). The transportation matching system can compare thisthree-dimensional representation to known representations of variousregions and identify where, in the environment, the requestor device islocated. Additional detail regarding the transportation matching system104 utilizing an environmental digital image to determine informationassociated with a transportation request (such as a transportationpickup location) is described in greater detail in FIG. 4.

In addition, as shown in FIG. 2, the transportation matching system 104performs an act 206 of displaying augmented reality elements for atransportation pickup location. For instance, the transportationmatching system 104 can cause the requestor computing device to displayan augmented reality element at the determined transportation pickuplocation within an environmental scene. To illustrate, thetransportation matching system 104 can generate a three-dimensionalmodel of the environment surrounding the requestor. The transportationmatching system 104 can then utilize the three-dimensional model toplace the augmented reality element at the pickup location such that therequestor computing device (e.g., a mobile device or augmented realityglasses) display the augmented reality element in the proper locationeven as the requestor computing device moves within the environment.Additional detail regarding displaying augmented reality elements isdescribed in greater detail below in FIGS. 5-10.

As mentioned above, the transportation matching system 104 can cause arequestor computing device to capture an environmental digital imagestream. For instance, FIG. 3 illustrates the transportation matchingsystem 104 capturing an environmental digital image stream (at an act304) upon identifying an indication to initiate a transportation requeston the requestor device (at an act 302).

The transportation matching system 104 can receive an indication toinitiate a transportation request in a variety of ways. In relation toFIG. 3, the transportation matching system 104 receives user selectionof a user interface element to initiate a request for transportationservices. In other embodiments, the transportation matching system 104can initiate a transportation request in response to other events (e.g.,when a user executes a transportation service mobile-app, based on anaudio command, or based on some other user interaction).

Upon receiving an indication to initiate a transportation request and/oran indication to provide a pickup location, the transportation matchingsystem 104 can capture an environmental digital image stream on (orwith) a requestor computing device to determine a pickup location. Forexample, FIG. 3 illustrates the transportation matching system 104capturing an environmental digital image stream in act 304. Inparticular, in one or more embodiments, the transportation matchingsystem 104 can utilize an environmental digital image stream captured ona camera of a requestor computing device to determine a pickup locationwithout having a requestor provide information within a map-based userinterface (i.e., a map-less user interface).

For instance, the environmental digital image stream can include acontinuous feed of digital images (or frames) captured on a camera of arequestor computing device. In particular, in one or more embodiments,the environmental digital image stream includes a video captured by thecamera of the requestor computing device. Indeed, the video captured bythe camera of the requestor computing device can include a live videofeed of the environment (e.g., the environmental scene) that therequestor currently is located during the transportation request.

Furthermore, in some embodiments, the transportation matching system 104can display an environmental digital image stream on a requestorcomputing device while a camera of the requestor computing devicecaptures the environmental digital image stream. Indeed, thetransportation matching system 104 can display the environmental digitalimage stream within a user interface of the transportation matchingapplication for selecting a pickup location and/or completing atransportation request. Additionally, in some embodiments, thetransportation matching system 104 can cause the requestor computingdevice to capture the environmental digital image stream withoutdisplaying the environmental digital image stream on a display of therequestor computing device. For instance, the transportation matchingsystem 104 may cause an augmented reality wearable device to utilize acamera to capture the environmental digital image stream withoutdisplaying the digital image stream. In particular, the augmentedreality wearable device, through transparent lenses, may already be inview of the environmental scene captured by the camera of the augmentedreality wearable device as the environmental digital image stream.

Additionally, the transportation matching system 104 can provideinstructions via the requestor computing device while capturing theenvironmental digital image stream. For example, the transportationmatching system 104 can provide instructions within a user interfacethat displays the environmental digital image stream during capture ofthe environmental digital image stream. Moreover, in some embodiments,the transportation matching system 104 utilizes augmented realityelements to provide instructions on the requestor computing device. Forinstance, the transportation matching system 104 can displayinstructions as one or more augmented reality elements within a displayof an environmental digital image stream within the requestor computingdevice and/or on transparent lenses of an augmented reality wearabledevice that is viewing the environmental scene. In some embodiments, thetransportation matching system 104 provides audio-based instructions viathe requestor computing device while capturing the environmental digitalimage stream and/or any other portion of the transportation requestprocess. Indeed, the transportation matching system 104 can provideinstructions with any of or any combination of graphical user interfaceelements, augmented reality elements, and/or audio-based elements.

The transportation matching system 104 can provide a variety ofinstructions in association with capturing the environmental digitalimage stream and/or determining the pickup location. For example, theinstructions can include requests and/or prompts that instructs therequestor to share their location. In particular, the instructions caninclude a prompt that instructs the requestor to position the camera ofthe requestor computing device to capture the environment of therequestor. Furthermore, in one or more embodiments, the transportationmatching system 104 can provide instructions to capture, in the cameraof the requestor computing device, a panoramic and/or 360-degree view ofthe requestor's current environment.

As mentioned above, the transportation matching system 104 can analyzean environmental digital image from an environmental digital imagestream to determine a transportation pickup location. For example, FIG.4 illustrates the transportation matching system 104 determining atransportation pickup location based on an environmental digital image.More specifically, FIG. 4 illustrates the transportation matching system104 receiving an environmental digital image from a requestor computingdevice that is capturing an environmental digital image stream,determining information for the transportation request (e.g., arequestor computing device location and a transportation pickuplocation) by analyzing the environmental digital image, and providingthe information related to the transportation request to the requestorcomputing device.

In one or more embodiments, the transportation matching system 104causes a requestor computing device to provide one or more environmentaldigital images to a remote server to analyze the one or moreenvironmental digital images. For instance, as shown in FIG. 4, thetransportation matching system 104 can cause the requestor computingdevice 402 (which can include a mobile device and/or an augmentedreality wearable device), that is capturing an environmental digitalimage stream, to provide an environmental digital image (at an act 404)to the server device(s) 102.

For instance, the transportation matching system 104 can receive one ormore digital images captured from the environmental digital image streamas the one or more environmental digital images (e.g., frames). In someembodiments, the transportation matching system 104 selects the one ormore digital images based on rules configured by the transportationmatching system 104. For example, the transportation matching system 104can cause the requestor computing device 402 to provide a digital imageat each interval frame of the environmental digital image stream. Insome embodiments, the transportation matching system 104 causes therequestor computing device to provide a digital image based on qualityof the digital image (or frames) of the environmental digital imagestream. For example, the transportation matching system 104 can receiveone or more digital images that are determined to be high quality images(e.g., images that are sharp, have minimal blur, are bright, etc.) froma requestor computing device.

In addition to the environmental digital image, the transportationmatching system 104 can receive other information associated with thetransportation request from the requestor computing device. Forinstance, the requestor computing device can provide other informationsuch as global position system information (GPS), selected destinationfor the transportation request, selected ride type, selected vehicletype, and/or schedule information. Moreover, the requestor computingdevice can provide other location based information such as WiFiconnection information (e.g., for determining location based ontriangulation). Additionally, the requestor computing device can alsoprovide requestor account information such as, but not limited to,transportation request preferences, demographics, and/or an age of therequestor.

Upon receiving an environmental digital image from an environmentaldigital image stream captured on a requestor computing device, thetransportation matching system 104 can utilize the environmental digitalimage to determine a requestor computing device location. Additionally,the transportation matching system 104 can utilize the determinedrequestor computing device location, from the environmental digitalimage, to determine various other information associated with atransportation request (e.g., a transportation pickup location). Forexample, FIG. 4 illustrates the transportation matching system 104determining information based on an analysis of the environmentaldigital image in act 406 (on server device(s) 102) to provide locationinformation 408 and transportation service information 410 to therequestor computing device 402.

For instance, the transportation matching system 104 can utilize imagerecognition applications and/or algorithms such as, but not limited to,structure from motion or imagery simultaneous localization and mapping(SLAM), to determine the location of the requestor computing device. Inparticular, the transportation matching system 104 can utilize SLAMapproaches to analyze digital images and determine a model of anenvironment portrayed in the digital images as well as positions of thecamera device(s) utilized to capture the digital images. Thus, thetransportation matching system 104 can utilize SLAM to determine a modelof an environment as well as positional locations (e.g., in a 2D plane)for devices utilized to capture the digital images. For instance, thetransportation matching system 104 can utilize SLAM to compare one ormore environmental digital images (or three-dimensional representationsof the one or more environmental images) to one or more known digitalimages (or known three-dimensional representations) corresponding tovarious locations to determine the location of a requestor computingdevice.

For example, in some embodiments, upon receiving one or moreenvironmental digital images from an environmental digital image stream,the transportation matching system 104 utilizes SLAM to generatethree-dimensional representations from the one or more environmentaldigital images. In some embodiments, the transportation matching system104 utilizes SLAM to generate three-dimensional point cloud collectiondata (of the environment of the requestor) from the one or moreenvironmental digital images.

In or more embodiments, the transportation matching system 104 comparessuch three-dimensional representations from the one or moreenvironmental digital images to a repository of known three-dimensionalrepresentations of various regions to identify where, in theenvironment, a requestor computing device is located. For example, thetransportation matching system 104 can utilize a repository of knownthree-dimensional representations of various regions that was generatedbased on scans (e.g., image capture, LiDAR, and/or sonar) of variousregions utilizing SLAM approaches and known location information. Inparticular, the repository of known three-dimensional representations ofvarious regions includes three-dimensional models of the various regionswith corresponding location information.

For instance, in one or more embodiments, the transportation matchingsystem 104 can gather digital images and corresponding locationinformation from various environments to generate a repository of knowndigital images (and/or known three-dimensional representations). Indeed,the known digital images (and/or known three-dimensionalrepresentations) can be labelled and/or tagged with locationinformation. For instance, in some embodiments, the transportationmatching system 104 utilizes SLAM to generate three-dimensionalrepresentations of various environments with corresponding location databased on scans (e.g., captured images, LiDAR, and/or Sonar) ofreal-world environments (e.g., streets, buildings, objects, and/orneighborhoods) for the repository of known three-dimensionalrepresentations of various regions.

As an example, the transportation matching system 104 can gather scansand location information from a vehicle that includes scanning equipmentto generate the repository of known three-dimensional representations ofvarious environments. For instance, the transportation matching system104 can utilize LiDAR equipment, 3D camera systems, and/or 360-degreecamera systems on a vehicle to scan various environments (e.g., thestreets of a city) to generate the repository of known digital images ofvarious environments (or known three-dimensional representations ofvarious environments). Furthermore, the transportation matching system104 can utilize location information from the vehicle that scans thevarious environments (at the time of the scans) to generatecorresponding location information for the known digital images ofvarious environments (or known three-dimensional representations orvarious environments).

Furthermore, as mentioned above, the transportation matching system 104can compare the one or more environmental digital images (orthree-dimensional representations generated from the one or moreenvironmental digital images) to a repository of one or more knowndigital images of various environments (or known three-dimensionalrepresentations of various environments) to determine the location of arequestor computing device. For instance, in or more embodiments, thetransportation matching system 104 can utilize SLAM to compare thefeatures (or data points) of the digital images (or three-dimensionalrepresentations) generated from the requestor computing device tofeatures of the digital images (or three-dimensional representations)generated from the repository of known three-dimensional representationsof various environments. Based on this comparison, the transportationmatching system 104 can determine a location of the requestor computingdevice utilized to capture the environmental digital images.

Indeed, based on identifying common features (e.g., traffic signs,street signs, street lights, curbs, no parking areas, fire hydrants, busstops, and/or other objects), the transportation matching system 104 canalign the three-dimensional representation generated from the one ormore environmental digital images with the three-dimensionalrepresentation of the known environment. Furthermore, in someembodiments, the transportation matching system 104 utilizes a 2D vectormap that corresponds to the aligned three-dimensional representation ofthe known environment to determine a location of the requestor computingdevice based on the positioning of the camera (or vantage point) of therequestor computing device within the three-dimensional representationgenerated from the one or more environmental digital images.

Additionally, the transportation matching system 104 can determineconfidence scores to one or more determined locations for a requestordevice (e.g., based on the level of alignment between correspondingfeatures). Indeed, the transportation matching system 104 can determineconfidence scores to the one or more determined locations to determinethe most accurate location of the environmental digital image (orrequestor computing device). In some embodiments, the transportationmatching system 104 utilizes other information associated with (orprovided by) the requestor computing device to assign confidence scoresto the identified locations. For instance, the transportation matchingsystem 104 can utilize information such as GPS location, a destinationlocation selected by the requestor, and a transportation request historyof the requestor to assign confidence scores to the identified matches(e.g., the transportation matching system 104 can assign a higherconfidence score to an identified location from the image recognitionmethods that corroborates with, or is in the proximity, of the GPSlocation provided by the requestor computing device).

Rather than analyze all potential locations, in some embodiments, thetransportation matching system 104 can analyze a subset of locations tomore quickly and efficiently identify a requestor location. For example,the transportation matching system 104 can filter known locations basedon information regarding the requestor's general location prior toanalyzing a digital image stream to determine a requestor location. Forinstance, the transportation matching system 104 can utilize general orhistorical GPS information, selected destination location, WiFiconnection information, transportation request history of the requestor,an event calendar of the requestor, historical locations of a requestor,and/or demographic information of the requestor to filter and/or finetune the known three-dimensional representations and/or known digitalimages of various environments utilized to determine a location of therequestor computing device. In particular, the transportation matchingsystem 104 can utilize this other location information to identify aproximal location of the requestor computing device and utilize SLAM toidentify a specific location corresponding to the proximal location.

In one or more embodiments, the transportation matching system 104utilizes tagging elements situated on objects in the real-worldenvironment to identify locations based on an environmental digitalimage. For instance, in one or more embodiments, the transportationmatching system 104 can utilize tagging elements such as a quickresponse code (QR code) stickers situated on objects in an environment(e.g., QR code stickers placed on light poles on a street) to identifythe location of the environmental scene portrayed in an environmentaldigital image. For example, the transportation matching system 104 canidentify the tagging element such as the QR code within theenvironmental digital image and scan the QR code to identify thelocation of the requestor computing device. Indeed, each QR code canrepresent a specific location.

Furthermore, the transportation matching system 104 may requestadditional environmental digital images from the requestor computingdevice when the transportation matching system 104 is unable todetermine a location from a provided environmental digital image. Forexample, if confidence scores fail to satisfy a confidence threshold,the transportation matching system 104 can cause the requestor computingdevice to continue to capture additional environmental digital images.In addition, the transportation matching system 104 can cause therequestor computing device to display instructions to instruct therequestor to capture additional perspectives of the environmental scenein the environmental digital image stream. For instance, upon notdetermining a location from an environmental digital image, thetransportation matching system 104 can provide instructions to capture apanoramic environmental digital image on the requestor computing device.The transportation matching system 104 can utilize the additionalenvironmental digital images to determine the location of the requestorcomputing device.

Additionally, upon determining the current location of the requestorcomputing device based on the one or more environmental digital images,the transportation matching system 104 can identify additionalinformation. For example, utilizing the current location and thetransportation request information provided by the requestor computingdevice the transportation matching system 104 can perform atransportation matching analysis. In particular, the transportationmatching system 104 can utilize the location determined from theenvironmental digital image and/or the transportation requestinformation (e.g., a destination location, a ride type, a vehicle type,etc.) to identify one or more transportation providers to service thetransportation request. Indeed, the transportation matching system 104can utilize a number of methods to determine an optimal matchingtransportation provider for the transportation request (e.g., nearesttransportation providers, transportation providers with the lowest ETA,transportation providers that have been waiting the longest, etc.).

Furthermore, in one or more embodiments, the transportation matchingsystem 104 can determine a pickup location. For example, thetransportation matching system 104 can utilize the current location, thetransportation request information provided by the requestor computingdevice, and the one or more identified transportation providers todetermine a transportation pickup location for the requestor (within theenvironment portrayed in the environmental digital image and/or based onthe determined location of the requestor computing device). Forinstance, the transportation matching system 104 can identify theorientation of the requestor in relation to the current determinedlocation, the orientation of the one or more identified transportationproviders, the traffic rules and/or customs for the location depicted inthe environmental digital image, and/or other objects within theenvironmental digital image (e.g., traffic signs, street signs, streetlights, curbs, no parking areas, fire hydrants, bus stops, no stoppingareas, etc.). Furthermore, the transportation matching system 104 canutilize such information to determine one or more transportation pickuplocations within the environmental scene of the current location of therequestor computing device and/or near the current location of therequestor computing device.

For instance, in one or more embodiments, the transportation matchingsystem 104 can identify a transportation provider that can service thetransportation request from the current location of the requestorcomputing device. Then, the transportation matching system 104 candetermine a route from the current location of the identifiedtransportation provider to the current location of the requestorcomputing device. Furthermore, the transportation matching system 104can utilize the determined route, the orientation of the requestor inrelation to the current location of the requestor, the traffic rulesand/or customs for the location depicted in the environmental digitalimage, and/or other objects within the environmental digital image(e.g., traffic signs, street signs, street lights, curbs, no parkingareas, fire hydrants, bus stops, etc.) to determine a transportationpickup location. In one or more embodiments, the transportation matchingsystem 104 can determine multiple transportation pickup locations formultiple identified transportation providers.

In one or more embodiments, the transportation matching system 104identifies designated (or standard) transportation pickup locationswithin the environmental scene of the current location of the requestorcomputing device and/or near the current location of the requestorcomputing device. In particular, the transportation matching system 104can utilize a collection (or set) of preexisting, known transportationpickup locations (e.g., a transportation pickup location assigned for alocation) as designated transportation pickup locations. Furthermore, insome embodiments, the transportation matching system 104 may includedesignated transportation provider locations for specific ride types,such as shared ride (e.g., ride pool). For example, the transportationmatching system 104 can identify that an environmental digital image (orcurrent location) includes a specific building and can identify that adesignated transportation pickup location exists in the determinedlocation of the environmental digital image at that specific building.As a result, the transportation matching system 104 can provide thedesignated transportation pickup location to the requestor computingdevice in response to the environmental digital image.

Upon identifying transportation providers, the transportation matchingsystem 104 can also determine information regarding the transportationservice (e.g., pickup information) for each transportation provider. Forinstance, as mentioned above, the transportation matching system 104 candetermine a travel route, ETA, ride type (e.g., single-user ride ormulti-user rides) or vehicle type corresponding to differenttransportation providers. Similarly, the transportation matching system104 can determine a cost of the transportation service (e.g., a cost totransport a requestor from the pickup location to a destination locationutilizing the transportation provider).

The transportation matching system 104 can utilize information regardingthe transportation service (in addition to information gleaned from theenvironmental digital images) to rank and select one or more pickuplocations and/or transportation providers. For example, thetransportation matching system 104 can rank a pickup location and/ortransportation provider based on distance between a requester and apickup location, time to travel to the pickup location, ETA, cost, ridetypes available, and/or vehicle types available. Furthermore, thetransportation matching system 104 can utilize (or provide) any numberof transportation pickup locations in response to the environmentaldigital image provided by the requestor computing device. In someembodiments, the transportation matching system 104 utilizes a thresholdnumber of transportation pickup location based on one or more of theattributes (or factors) discussed above (e.g., the cost, estimated timeof arrival, transportation provider rankings, etc.).

For instance, as shown in FIG. 4, the requestor computing deviceprovides to server device(s) 102 an environmental digital image thatdepicts an environmental scene in which the requestor is positioned(e.g., a street corner with buildings) (at an act 404). Then, thetransportation matching system 104 analyzes the environmental digitalimage to determine the current location of the requestor (e.g., thephysical location corresponding to the street corner depicted within theenvironmental digital image). Furthermore, the transportation matchingsystem 104 determines a transportation pickup location within theenvironmental scene portrayed in the environmental digital image and/orbased on the location of the environmental digital image. For instance,the transportation matching system 104 can determine a transportationpickup location across the street (within the environmental sceneportrayed in the environmental digital image provided in act 404) nearthe building across the street based on identifying that atransportation provider is travelling towards the building.

Furthermore, as illustrated in FIG. 4, the transportation matchingsystem 104 determine and provide transportation service information 410.For example, the transportation matching system 104 can provide theestimated time of arrival for the transportation provider, the distanceof the transportation provider to the current location of the requestorcomputing device, distance to the transportation pickup location, ridetype, vehicle type, cost, and/or the total time to complete thetransportation request.

In addition, the transportation matching system 104 can also compareinformation across different transportation providers and/or pickuplocations. For example, the transportation service information 410 caninclude comparisons between ETAs and/or costs of multiple transportationpickup locations, ride types, and/or matched transportation providers.Indeed, the transportation matching system 104 can provide suchinformation (e.g., the location information 408 and/or thetransportation service information 410) to enable creation and/ordisplay of augmented reality elements on the requestor computing device(e.g., indicate where in the environmental scene the transportationpickup location is positioned).

As mentioned above, the transportation matching system 104 can provide,for display on a requestor computing device, an augmented realityelement at the transportation pickup location within an environmentalscene that includes the transportation pickup location. For instance,FIG. 5A illustrates the transportation matching system 104 providing anaugmented reality element for display on a requestor computing devicebased on a transportation pickup location. In particular, FIG. 5Aillustrates the transportation matching system 104 providing anaugmented reality element 506 at a determined transportation pickuplocation for display on a requestor computing device 502 within anenvironmental scene 504.

As shown in FIG. 5A, the environmental scene 504 is captured within anenvironmental digital image stream from the camera of the requestorcomputing device 502 and displayed on the screen of the requestorcomputing device 502. Indeed, as shown in FIG. 5A, the transportationmatching system 104 can also include an augmented reality element 508that includes transportation service information such as an ETA (e.g.,“ETA: 5 min”) and a cost (e.g., “Price: $5.12”) for the transportationpickup location corresponding to a transportation request. Moreover, asshown in FIG. 5A, the transportation matching system 104 can include agraphical user interface element 510 to display informationcorresponding to the transportation request (e.g., “Lyft Request to: 123Copper Street”).

In one or more embodiments, the transportation matching system 104causes the requestor computing device to create (or generate) augmentedreality elements based on the information determined from theenvironmental digital image (as described above). For instance, thetransportation matching system 104 causes the requestor computing deviceto create (or generate) augmented reality elements based on informationsuch as, but not limited to, a determined transportation pickuplocation, a current location of the requestor computing device, costs ofthe transportation request, ETAs corresponding to the transportationrequests, information of a matched transportation provider, and/or acountdown timer for the transportation request (e.g., the amount of timethe transportation request will stay available). Furthermore, theaugmented reality elements can update to relay information such as timechanges and/or other information changes (e.g., a change in ETA and/or acountdown timer). Indeed, the transportation matching system 104 cancause the requestor computing device to display such information as oneor more augmented reality elements within an environmental scene that isrelevant to such information (e.g., an environmental scene that includesthe transportation pickup location within the scene).

In one or more embodiments, the transportation matching system 104provides the determined transportation pickup location withcorresponding data to identify where, within an environmental digitalimage, the transportation pickup location is located. For example, thetransportation matching system 104 can cause the requestor computingdevice to create (or display) an augmented reality element (e.g., apointer, a cone, a flag, etc.) within an environmental scene associatedwith the environmental digital image at the transportation pickuplocation based on the data that identifies where within theenvironmental digital image the transportation pickup location islocated. Indeed, by displaying an augmented reality element at thetransportation pickup location within an environmental scene, arequestor is able to identify where the transportation pickup locationis within their surroundings without utilizing a map and/or otherinformation.

Moreover, the transportation matching system 104 can cause the requestorcomputing device to update the positioning of augmented reality elementswithin the environmental scene based on changes in orientation of therespondent computing device. For instance, the transportation matchingsystem 104 can cause the requestor computing device to update thepositioning of the augmented reality element that indicates atransportation pickup location to remain located at the transportationpickup location as the environmental scene changes. For instance, theenvironmental scene changes can result from movement of the requestor,movement of a view point of the requestor computing device, and/ormovement of the camera of the requestor computing device.

Additionally, the transportation matching system 104 can cause therequestor computing device to display other information as augmentedreality elements and/or graphical user interface elements within anenvironmental scene. For example, the transportation matching system 104can cause the requestor computing device to display information such asinformation corresponding to the transportation request. In particular,the displayed information can include a destination location and/oroptions selected by the requestor for the transportation request (e.g.,a ride type, a vehicle type, etc.).

Moreover, the transportation matching system 104 can cause the requestorcomputing device to display augmented reality elements and/or graphicaluser interface elements that point towards (or guide towards) adetermined transportation pickup location. For instance, thetransportation matching system 104 can identify that the transportationpickup location is not within the current environmental scene portrayedin the environmental digital image stream on the requestor computingdevice (e.g., the requestor changed orientation and/or moved the vantagepoint of the camera). Upon identifying that the transportation pickuplocation is not within the current environmental scene, thetransportation matching system 104 can cause the requestor computingdevice to display augmented reality elements and/or graphical userinterface elements (e.g., arrows, pointers, text, etc.) that instructthe requestor to move the requestor computing device camera in thedirection of the environmental scene that includes the transportationpickup location to display the augmented reality element correspondingto the transportation pickup location.

Furthermore, the transportation matching system 104 can cause therequestor computing device to display information such as a confirmationand/or transportation provider information (e.g., informationcorresponding to the transportation provider that will service thetransportation request). In particular, the transportation matchingsystem 104 can display such information upon sending the transportationrequest to a transportation provider for the determined transportationpickup location (e.g., the transportation pickup location di splayed asthe augmented reality element).

In one or more embodiments, the transportation matching system 104 canidentify interactions with the augmented reality elements. Indeed, theaugmented reality elements and/or the displayed environmental scene caninclude selectable elements corresponding to the positions of theaugmented reality elements. For instance, the transportation matchingsystem 104 can identify interactions on a touchscreen of a requestorcomputing device at positions corresponding to augmented realityelements displayed within an environmental scene on the touchscreendisplay. Indeed, the transportation matching system 104 can send atransportation request to a transportation provider for thetransportation pickup location that is selected by the requestor via aninteraction with the touchscreen display of the requestor computingdevice.

In some embodiments, the transportation matching system 104 can detectinteractions such as gestures within an environmental digital imagestream that is capturing the environmental scene in which thetransportation pickup location and corresponding augmented realityelements are positioned (or displayed). For instance, the transportationmatching system 104 can detect a hand of the requestor, within theenvironmental digital image stream that is capturing the environmentalscene, pointing at the augmented reality element corresponding to thetransportation pickup location. In particular, the transportationmatching system 104 can send the transportation request to atransportation provider for the transportation pickup location based ondetecting gestures such as the requestor pointing at the augmentedreality element within the environmental digital image stream.Additionally, the transportation matching system 104 can send thetransportation request to a transportation provider upon identifyingthat the requestor is moving towards the determined transportationpickup location (as described in greater detail in FIG. 8).

In addition, as mentioned above, the transportation matching system 104can display one or more augmented reality elements on an augmentedreality wearable device that is viewing the environmental scene (e.g.,viewing the environmental scene via a camera of the augmented realitywearable device that is capturing an environmental digital stream). Forinstance, FIG. 5B illustrates the transportation matching system 104displaying an augmented reality element at a determined transportationpickup location, within an environmental scene, through an augmentedreality wearable device (e.g., augmented reality glasses withtransparent lenses that enable a requestor to view an environment and/orenvironmental scene). Indeed, the transportation matching system 104 candisplay one or more augmented reality elements and/or provide otherfunctionalities on an augmented reality wearable device in accordancewith one or more embodiments described above. In particular, thetransportation matching system 104 can cause an augmented realitywearable device to display one or more augmented reality elementsportraying information such as, but not limited to, informationregarding transportation pickup location, information regarding anidentified transportation provider, information regarding thetransportation request, and/or information regarding the completion ofthe transportation request as described above in FIG. 5A.

For example, FIG. 5B illustrates the requestor 110 a within anenvironment 512 (e.g., an urban area). Furthermore, as shown in FIG. 5B,the requestor 110 a views the environment 512 with augmented realityglasses 514. As illustrated in FIG. 5B, the transportation matchingsystem 104 can also cause the augmented reality glasses 514 to displayan augmented reality element 518 (e.g., a pin) within an environmentalscene 516 (e.g., the view of the environment 512 through a transparentlens of the augmented reality glasses 514). In addition, as shown inFIG. 5B, the transportation matching system 104 can cause the augmentedreality glasses 514 to display the augmented reality element 518 at adetermined transportation pickup location within the environmental scene516.

Moreover, as shown in FIG. 5B, the transportation matching system 104can cause the augmented reality glasses 514 to display information in anaugmented reality element 520 (e.g., a pickup location indication, anETA, and a price of the transportation service request from thetransportation pickup location). Furthermore, as illustrated in FIG. 5B,the transportation matching system 104 can cause the augmented realityglasses 514 to display, as an augmented reality element and/or graphicaluser interface, information 522 (e.g., the transportation requestinformation “Lyft Request to: 123 Copper Street”). Indeed, theinformation 522 can include a variety of information such as, but notlimited to, information regarding transportation pickup location,information regarding the identified transportation provider,information regarding the transportation request, and/or informationregarding the completion of the transportation request.

Furthermore, the transportation matching system 104 can identifyinteractions and/or actions of a requestor (e.g., the requestor 110 a)with an augmented reality wearable device (e.g., the augmented realityglasses 514). For example, as described above, the transportationmatching system 104 can identify gestures of the requestor within anenvironmental scene (e.g., the environmental scene 516) that is in viewof the augmented reality wearable device. For instance, thetransportation matching system 104 can identify a hand of the requestor,within the environmental scene, pointing at an augmented reality elementcorresponding to a transportation pickup location (e.g., the augmentedreality element 518). Moreover, the transportation matching system 104can identify voice commands via the augmented reality wearable devicefrom the requestor. Furthermore, the transportation matching system 104can also identify that the requestor is moving towards the determinedtransportation pickup location (as described in greater detail in FIG.8). Indeed, as described in one or more embodiments herein, thetransportation matching system 104 can send a transportation request toa transportation provider based on the interactions and/or the actionsof the requestor with the augmented reality wearable device.

Additionally, the transportation matching system 104 can cause arequestor computing device to display multiple augmented realityelements for multiple determined transportation pickup locations withinan environmental scene. For instance, FIG. 6 illustrates thetransportation matching system 104 causing a requestor computing deviceto display multiple augmented reality elements for multiple determinedtransportation pickup locations. In particular, the transportationmatching system 104 can indicate multiple transportation pickuplocations within an environmental scene, can display information basedon comparisons and/or analysis of one or more available transportationservices available at the transportation pickup locations, and/ordisplay other information corresponding to the multiple transportationpickup locations. Furthermore, the transportation matching system 104can also identify interactions from a requestor to enable selections (orinteractions) with the multiple augmented reality elements and/ortransportation pickup locations. Additionally, although FIG. 6illustrates the transportation matching system 104 providing multipleaugmented reality elements on a mobile device, the transportationmatching system 104 can similarly display multiple augmented realityelements, multiple transportation pickup locations, comparisoninformation, and/or other information described herein on an augmentedreality wearable device (e.g., as described in FIG. 5B).

As mentioned above, the transportation matching system 104 can cause arequestor computing device to display multiple augmented realityelements, within an environmental scene, at multiple transportationpickup locations. For instance, as shown in FIG. 6, the transportationmatching system 104 can cause a requestor computing device 602 (e.g., amobile device) to display an augmented reality element 606 at a firsttransportation pickup location and an augmented reality element 610 at asecond transportation pickup location within the environmental scene604. Additionally, as shown in FIG. 6, the transportation matchingsystem 104 can cause the requestor computing device 602 to displayinformation 608 (e.g., “Pickup Location 1,” “ETA: 5 min,” and “Price:$5.12”) corresponding to the first transportation pickup location andinformation 612 (e.g., “Pickup Location 2,” “ETA: 6 min,” and “Price:$6.04”) corresponding to the second transportation pickup location asaugmented reality elements within the environmental scene 604.Additionally, as shown in FIG. 6, the transportation matching system 104can cause the requestor computing device 602 to display, as an augmentedreality element and/or graphical user interface, information 614 (e.g.,the transportation request information “Lyft Request to: 123 CopperStreet”). Indeed, the information 614 can include, but is not limitedto, information regarding transportation pickup location, informationregarding the identified transportation provider, information regardingthe transportation request, and/or information regarding the completionof the transportation request.

In one or more embodiments, the transportation matching system 104determines multiple transportation pickup locations and displaysaugmented reality elements within an environmental scene at each oftransportation pickup locations as described in the figures above.Furthermore, although FIG. 6 illustrates the transportation matchingsystem 104 displaying augmented reality elements for two transportationpickup locations, the transportation matching system 104 can cause arequestor computing device to display any number of augmented realityelements at any number of transportation pickup locations. In addition,the transportation matching system 104 can display (or provide) the sameand/or different information and/or different transportation serviceoptions at each of the transportation pickup locations based ontransportation provider matching analyses performed by thetransportation matching system 104.

Furthermore, the transportation matching system 104 can cause arequestor computing device to display augmented reality elements and/orgraphical user interface elements with alternative or additionalinformation. For instance, the transportation matching system 104 cancause the requestor computing device to display comparisons betweenmultiple transportation pickup locations and/or transportation serviceoptions as augmented reality elements and/or graphical user interfaceelements. As an example, in one or more embodiments, the transportationmatching system 104 calculates differences between multipletransportation pickup locations (e.g., a difference in ETA and/or price)and causes the requestor computing device to display the calculatedinformation as an augmented reality and/or graphical user interfaceelement within the environmental scene. For instance, the transportationmatching system 104 can display a primary transportation pickup locationand display other transportation pickup locations with a calculatedcomparison such as “this pickup location costs $4.00 less” within anenvironmental scene. Moreover, in some embodiments, the transportationmatching system 104 causes the requestor computing device to displayaugmented reality elements to highlight the best availabletransportation pickup location (e.g., the most efficient pickup locationand/or most cost-effective pickup location for the requestor).

In addition, the transportation matching system 104 can base thecalculated information (or comparisons) on requestor preferences. Forinstance, the transportation matching system 104 can determine that arequestor prefers faster ETAs rather than price, and as a result, thecalculated information displayed to the requestor (via augmented realityelements and/or graphical user interface elements within anenvironmental scene) can include information on differences in ETA timesbetween multiple transportation pickup locations. Indeed, thepreferences can include, but are not limited to, ETA preferences, pricepreferences, vehicle type preferences, ride type preferences, etc.

Additionally, the transportation matching system 104 can cause therequestor computing device to inform and/or notify a requestor of otheravailable transportation service options via augmented reality elements(and/or graphical user interface elements). For example, thetransportation matching system 104 can cause the requestor computingdevice to display augmented reality elements and/or graphical userinterface elements to notify and/or inform a requestor of otheravailable transportation services and/or transportation pickup locationsbased on ETA, price, and/or other information. For instance, thetransportation matching system 104 can cause the requestor computingdevice to display augmented reality elements to indicate that a lessexpensive transportation pickup location is available nearby (or withinthe environmental scene). Additionally, the transportation matchingsystem 104 can cause the requestor computing device to display augmentedreality elements to indicate that other ride types (e.g., a shared ride)and/or other vehicle types are available at one or more transportationpickup locations. The transportation matching system 104 can cause therequestor computing device to display augmented reality elements toguide the requestor to other transportation pickup locations that arenot within the environmental scene by utilizing one or more methodsdescribed in the figures below.

Moreover, the transportation matching system 104 can cause the requestorcomputing device to display augmented reality elements for offersassociated with the transportation (e.g., an offer indicating that atransportation service available at a later time will be less expensiveto the requestor). Furthermore, the offers can correspond to augmentedreality elements that indicate a location (e.g., a café within theenvironmental scene, a library, a bus stop, etc.) where the requestorcan wait until the later available transportation service. For example,the transportation matching system 104 can cause the requestor computingdevice to display an augmented reality element at a transportationpickup location within an environmental scene, a price for thetransportation pickup location, and an offer that indicates that thetransportation pickup location will be less expensive at a later timeperiod (and/or an offer for a product or service at a businesscorresponding to the pickup location). Indeed, the transportationmatching system 104 can utilize any number of matching analyses,comparing methods, and/or algorithms to determine comparisons and/oroptions for the transportation request for display as augmented realityelements within an environmental scene.

Furthermore, the transportation matching system 104 can identifyinteractions and/or actions of a requestor with a requestor computingdevice that displays multiple augmented reality elements for multipletransportation pickup locations and/or options in accordance with one ormore embodiments herein. For example, as described above, thetransportation matching system 104 can identify gestures of therequestor within an environmental scene that displays the multipleaugmented reality elements. For instance, the transportation matchingsystem 104 can identify a hand of the requestor, within theenvironmental scene, pointing at one augmented reality elementcorresponding to a first transportation pickup location amongst themultiple augmented reality elements, each corresponding to atransportation pickup location. Indeed, the transportation matchingsystem 104 can identify such an interaction as a selection of the firsttransportation pickup location. Moreover, the transportation matchingsystem 104 can identify voice commands via the requestor computingdevice from the requestor for selections between the multipletransportation pickup locations. Additionally, the transportationmatching system 104 can also identify that the requestor is movingtowards one of the determined transportation pickup locations from themultiple transportation pickup locations using methods described ingreater detail in FIG. 8. Indeed, as described in one or moreembodiments herein, the transportation matching system 104 can send atransportation request to a transportation provider (corresponding tothe selected transportation pickup location) based on the interactionsand/or the actions of the requestor with the requestor computing device.

As mentioned above, the transportation matching system 104 can provide,for display on a requestor computing device, an augmented realityelement (or augmented reality directional element) that displays a pathto a transportation pickup location within an environmental scene. Forinstance, FIG. 7 illustrates the transportation matching system 104causing a requestor computing device to display an augmented realityelement that indicates a path to a transportation pickup location withinan environmental scene from the current location of the requestorcomputing device (or requestor). In particular, as shown in FIG. 7, thetransportation matching system 104 can cause the requestor computingdevice 702 to display an augmented reality element 706 (e.g., a guidedpath) to a determined transportation pickup location indicated by anaugmented reality element 708 within the environmental scene 704.Indeed, the augmented reality element 706 (e.g., a guided path) canassist a requestor to travel to the determined transportation pickuplocation (e.g., the location indicated by the augmented reality element708).

In one or more embodiments, the transportation matching system 104displays (or provides) an augmented reality element to display a path tothe transportation pickup location by utilizing information such as, butnot limited to, the current location of the requestor computing deviceand/or the location of the transportation pickup location. For example,the transportation matching system 104 can determine a path between thecurrent location of the requestor computing device and the location ofthe transportation pickup location (within the three-dimensionalrepresentation generated from the one or more environmental digitalimages as described above). Then, the transportation matching system 104can cause the requestor computing device to display one or moreaugmented reality elements (e.g., an arrow and/or a line) along thedetermined path within an environmental scene which includes the pathlocation. In one or more embodiments, the transportation matching system104 can cause requestor computing device to update and/or change thedisplayed one or more augmented reality elements that represent the pathto reflect changes in the current position of the requestor computingdevice (e.g., movement of the requestor) and/or changes in the positionof the camera of the requestor computing device.

Moreover, the transportation matching system 104 can cause the requestorcomputing device to display one or more augmented reality elements toindicate multiple paths when there are multiple transportation pickuplocations (in accordance with one or more embodiments herein). Forexample, the transportation matching system 104 can cause the requestorcomputing device to display, via augmented reality elements, separatepaths within an environmental scene to each transportation pickuplocation. In some embodiments, the transportation matching system 104can cause the requestor computing device to distinguish the augmentedreality elements for each path by utilizing labels and/or visual changesto each of the augmented reality elements (e.g., different colors foreach path).

Also, the transportation matching system 104 can cause the requestorcomputing device to display one or more augmented reality elements toindicate paths to transportation pickup locations that are not within acurrent environmental scene of the requestor computing device (e.g., notwithin the view of the camera of the requestor computing device). Forexample, the transportation matching system 104 can cause the requestorcomputing device to display one or more augmented reality elements thatindicate a path to a transportation pickup location. For instance, thetransportation matching system 104 can cause the requestor computingdevice to display an augmented reality element such as an arrow thatdirects the requestor towards a transportation pickup location, that isnearby, but not in the environmental scene, because of obstructions dueto objects (e.g., buildings) and/or because the transportation pickuplocation is located outside of the viewpoint of the requestor computingdevice and/or the requestor (e.g., a transportation pickup locationlocated behind the requestor).

In one or more embodiments, the transportation matching system 104 (orrequestor computing device) can create (or display) a variety ofaugmented reality elements to indicate a path. For instance, theaugmented reality elements that indicate a path can include an arrowpointing towards the transportation pickup location within theenvironmental scene and/or a line tracing the path within anenvironmental scene. Additionally, the transportation matching system104 can cause the requestor computing device to display one or moreaugmented reality elements within the environmental scene correspondingto information associated with the determined path and/or guidance tothe transportation pickup location. For instance, the transportationmatching system 104 can cause the requestor computing device to displayone or more augmented reality elements, within the environmental scene,for information such as, but not limited to, a distance value betweenthe current location and the transportation pickup location and/or atime to travel to the transportation pickup location. In addition, thetransportation matching system 104 can also cause the requestorcomputing device to provide information corresponding to the determinedpath and/or guidance to the transportation pickup location via audioprompts and/or graphical user interface prompts.

Furthermore, the transportation matching system 104 can also cause therequestor computing device to display one or more augmented realityelements within the environmental scene that correspond to objectsand/or obstacles within the environmental scene. For example, thetransportation matching system 104 can utilize one or more imagerecognition methods to identify one or more objects and/or obstacles(e.g., traffic signs, street signs, streetlights, curbs, no parkingareas, fire hydrants, bus stops, etc.) as described above. In addition,the transportation matching system 104 can cause the requestor computingdevice to display one or more augmented reality elements at theidentified objects and/or obstacles within an environmental scene toprovide the requestor with additional information corresponding toguidance to the transportation pickup location. For instance, thetransportation matching system 104 can cause the requestor computingdevice to display an augmented reality element at a location recognizedas a no stopping area within the environmental scene to indicate to therequestor that a transportation provider will be unable to stop at thelocation indicated by the augmented reality element.

Although FIG. 7 illustrates (or describes) one or more embodiments ofthe transportation matching system 104 within a mobile device, thetransportation matching system 104 can similarly display augmentedreality elements indicating a path and/or obstacle within an augmentedreality wearable device (e.g., as described in FIG. 5B) in accordancewith one or more embodiments herein.

As mentioned above, the transportation matching system 104 can send atransportation request to a transportation provider upon detecting (oridentifying) that a requestor is moving towards a determinedtransportation pickup location. For instance, FIG. 8 illustrates anexample embodiment in which the transportation matching system 104 sendsa transportation request to a transportation provider upon identifyingthat a requestor (or requestor computing device) is near a determinedtransportation pickup location (e.g., a transportation pickup locationdisplayed as an augmented reality element within an environmentalscene). For instance, as shown in FIG. 8, the transportation matchingsystem 104 can cause a requestor computing device 802 to display anaugmented reality element for a transportation pickup location 810 and apath to the transportation pickup location from the current location ofthe requestor computing device 802. Indeed, as shown in FIG. 8, thetransportation matching system 104 can determine the current location ofthe requestor computing device 802 and track the movement of therequestor computing device 802 to detect that the requestor is movingtowards a determined transportation pickup location (e.g., thetransportation pickup location 810).

Furthermore, as shown in FIG. 8, the transportation matching system 104can track the current location 812 of the requestor computing device 802in relation to a threshold proximity 808 of the transportation pickuplocation 810 in tracking map 804 (e.g., a tracking feature that is notdisplayed to the requestor) in act 816. Moreover, as the currentlocation 812 of the requestor computing device 802 changes (or updates),the transportation matching system 104 can update the trackinginformation of the requestor computing device to detect whether therequestor computing device is moving towards the transportation pickuplocation 810. For instance, as shown in FIG. 8, when the requestorcomputing device 802 moves towards the transportation pickup location810 in act 818, the transportation matching system 104 can determine anupdated tracking map 806 in which the current location 812 of therequestor computing device 802 is within the threshold proximity 808 ofthe transportation pickup location 810. Although FIG. 8 illustrates thetransportation matching system 104 utilizing a tracking map, thetransportation matching system 104 can utilize a variety of methods tokeep track of a requestor computing device in relation to atransportation pickup location such as, but not limited to, a log oftracked location data.

Indeed, as shown in FIG. 8, upon detecting that the current location 812of the requestor computing device 802 is within the threshold proximity808, the transportation matching system 104 can send a transportationrequest to a transportation provider in act 814 in accordance with oneor more embodiments herein. Furthermore, upon sending the transportationrequest to a transportation provider in act 814, the transportationmatching system 104 can cause the requestor computing device 802 todisplay an augmented reality element (and/or a graphical user interfaceelement) to indicate that a transportation request has been sent. Forinstance, as shown in FIG. 8, the transportation matching system 104causes the requestor computing device to display the augmented realityelement indicating “Ride Requested!”

In one or more embodiments, the transportation matching system 104configures the threshold proximity utilized to identify if a requestorcomputing device is moving towards a transportation pickup location. Inparticular, the threshold proximity can include any number of shapes,ranges, and/or sizes to create a zone around a transportation pickuplocation. Furthermore, the transportation matching system 104 cancustomize the threshold proximity based on, but not limited to, arequestor transportation request history, the number of transportationproviders available, the number of transportation requests within theregion where the transportation pickup location is located, and/orpreferences received from the requestor.

Furthermore, as shown in FIG. 8, the transportation matching system 104can cause the requestor computing device 802 to display one or moreaugmented reality elements to indicate a path from the current locationof the requestor computing device 802 to the transportation pickuplocation 810. Indeed, the transportation matching system 104 can causethe requestor computing device 802 to display one or more augmentedreality elements to indicate a path as described above in FIG. 7. Insome embodiments, the transportation matching system 104 can detect thata requestor computing device is moving towards a transportation pickuplocation (and/or send a transportation request) in accordance with oneor more embodiments herein without displaying a path as an augmentedreality element within the environmental scene of the requestorcomputing device. Furthermore, the transportation matching system 104can provide multiple transportation pickup locations, as describedabove, and detect movement of the requestor computing device towards anyof the transportation pickup locations in accordance with one or moreembodiments herein.

Additionally, in one or more embodiments, the transportation matchingsystem 104 can track the location of a requestor computing device. Forinstance, in one or more embodiments, the transportation matching system104 utilizes a dead reckoning method to track the location of arequestor computing device. In particular, the transportation matchingsystem 104 can identify an initial location of the requestor computingdevice (based on an environmental digital image provided from therequestor computing device, as described above) and then use deadreckoning approaches to track the relative movement of the requestorcomputing device from the initial location. For example, thetransportation matching system 104 can identify local movementinformation (e.g., information corresponding to movement) from therequestor device (e.g., a step counter, IMU, accelerometer, changes inGPS on the requestor device, and/or changes in other signals such as,but not limited to, Bluetooth and WiFi) to advance the position of therequestor computing device from the previously determined location ofthe requestor computing device, determined from the environmentaldigital image. As an example, the transportation matching system 104 candetermine, utilizing movement of the requestor computing device, that arequestor is moving ten meters north from the determined initiallocation of the requestor computing device and advance the location (orposition) of the requestor computing device ten meters north from thedetermined initial location.

In one or more embodiments, the transportation matching system 104 canutilize WiFi proximity to track updates in the location of the requestorcomputing device. For instance, the transportation matching system 104can identify nearby WiFi access points, on the requestor computingdevice, and track the proximity of the requestor computing device to theidentified nearby WiFi access points (e.g., utilizing triangulation) toupdate and/or track the location of the requestor computing device inrelation to a transportation pickup location. Similarly, thetransportation matching system 104 can include sensors within theenvironment that the requestor is positioned (e.g., RFID chips,Bluetooth sensors, NFC tags, etc.). Indeed, the transportation matchingsystem 104 can include such sensors within physical objects in theenvironment such as, but not limited to, street signs, sidewalks,buildings, posts, and/or street lights. For example, the transportationmatching system 104 can identify such nearby sensor, on the requestorcomputing device, and track the proximity of the requestor computingdevice to such nearby sensors. Moreover, the transportation matchingsystem 104 can utilize such sensors to update and/or track the locationof the requestor computing device in relation to the transportationpickup location.

Additionally, in some embodiments, the transportation matching system104 can utilize the environmental digital image stream captured on therequestor computing device to update and/or track the location of therequestor computing device. For example, the transportation matchingsystem 104 can analyze updated environmental digital images from theenvironmental digital image stream to update the current location of therequestor computing device. In some embodiments, the transportationmatching system 104 can utilize the environmental digital image streamto track whether the requestor computing device is following anaugmented reality element indicating a path between the requestorcomputing device and the transportation pickup location to update and/ortrack the location of the requestor computing device in relation to thetransportation pickup location.

Moreover, as mentioned above, the transportation matching system 104 cansend a transportation request to a transportation provider upondetermining that the requestor computing device is within a thresholdproximity of the transportation pickup location. Indeed, thetransportation matching system 104 can send the transportation requestto the transportation provider as described in one or more embodimentsabove. Furthermore, the transportation matching system 104 can cause therequestor computing device to display one or more augmented realityelements and/or graphical user interface elements corresponding toinformation for the sent transportation request. Indeed, the informationcan include, but is not limited to, transportation provider information,the time of arrival for the transportation provider, and/or the distanceof the transportation provider from the transportation pickup location.

Furthermore, in some embodiments, the transportation matching system 104sends the transportation request to a transportation provider upondetecting that the requestor computing device is moving towards thetransportation pickup location. For instance, the transportationmatching system 104 can send the transportation request to thetransportation provider immediately upon detecting a movement, from therequestor computing device, towards the transportation pickup location.In particular, in some embodiments, the transportation matching system104 utilizes a greater diameter in the threshold proximity to send thetransportation request to the transportation provider earlier.Additionally, in one or more embodiments, the transportation matchingsystem 104 can send the transportation request to the transportationprovider upon detecting that the requestor computing device is followingthe path displayed as an augmented reality element within theenvironmental scene on the requestor computing device. Moreover, thetransportation matching system 104 can send the transportation requestto the transportation provider based on other interactions from therequestor with the requestor computing device as described in one ormore figures above.

Additionally, the transportation matching system 104 can cancel (orterminate) the transportation request based on the tracked location ofthe requestor computing device. For example, the transportation matchingsystem 104 can cancel the transportation request if the requestorcomputing device, via tracked location information, is not within athreshold proximity of the transportation pickup location during athreshold cancellation time period. Indeed, in one or more embodiments,the transportation matching system 104 causes the requestor computingdevice to display, as an augmented reality element and/or as a graphicaluser interface element, the threshold cancellation time period (e.g., acountdown timer) within the environmental scene.

Furthermore, although FIG. 8 illustrates (or describes) one or moreembodiments of the transportation matching system 104 within a mobiledevice, the transportation matching system 104 can similarly track thelocation of an augmented reality wearable device (e.g., as described inFIG. 5B) to send a transportation request to a transportation providerin accordance with one or more embodiments herein.

Furthermore, the transportation matching system 104 can cause atransportation provider computing device (e.g., a transportationprovider computing device 112) to display one or more augmented realityelements within an environmental scene. For example, FIG. 9 illustratesthe transportation matching system 104 causing a transportation providercomputing device to display one or more augmented reality elements basedon information determined by the transportation matching system 104. Forexample, the transportation matching system 104 can utilize informationsuch as, but not limited to, the transportation pickup location data,requestor computing device location data, and/or requestor profile datato cause a transportation provider computing device to display one ormore augmented reality elements within an environmental scene thatcorresponds to such information.

In one or more embodiments, the transportation provider computing deviceincludes a mobile device of the transportation provider, a vehiclecomputing system with a dashboard display, an augmented reality enabledwindshield, and/or an augmented reality wearable device for thetransportation provider. Indeed, the transportation provider computingdevice can capture a digital image stream and/or display augmentedreality elements within an environmental scene as described above in oneor more figures for the requestor computing devices. Furthermore, thetransportation matching system 104 can receive and analyze environmentaldigital images from the transportation provider computing device asdescribed above in one or more figures for the requestor computingdevices. For example, the transportation matching system 104 can receiveenvironmental digital images from the transportation provider computingdevice and determine a location of the transportation provider computingdevice based on the environmental digital images in accordance with oneor more embodiments described herein.

Additionally, the transportation matching system 104 can cause thetransportation provider computing device to display one or moreaugmented reality elements (and/or graphical user interface elements) inaccordance with one or more embodiments described herein. For instance,the transportation matching system 104 can cause the transportationprovider computing device to display an augmented reality element at atransportation pickup location within an environmental scene thatincludes the transportation pickup location. Additionally, thetransportation matching system 104 can cause the transportation providercomputing device to display one or more augmented reality elements forinformation corresponding to a requestor (e.g., the identity of arequestor). Moreover, the transportation matching system 104 can alsocause the transportation provider computing device to display one ormore augmented reality elements to display a path (or directions) to atransportation pickup location (in accordance with one or moreembodiments described herein) and/or to a destination location.

For example, FIG. 9 illustrates the transportation matching system 104causing a transportation provider computing device (e.g., an augmentedreality enabled windshield 902 of a vehicle) to display one or moreaugmented reality elements. For instance, as shown in FIG. 9, thetransportation matching system 104 causes the augmented reality enabledwindshield 902 to display an augmented reality element 906 andinformation 908 (e.g., “Pickup Location”) at the transportation pickuplocation within an environmental scene 904. Additionally, as shown inFIG. 9, the transportation matching system 104 causes the augmentedreality enabled windshield 902 to display information 912 (e.g.,“Passenger”) as an augmented reality element at the location of arequestor computing device. Furthermore, the transportation matchingsystem 104 can cause the augmented reality enabled windshield 902 todisplay an augmented reality element 910 to indicate the location of arequestor 110 a (e.g., based on image recognition and/or the location ofthe requestor computing device). Although FIG. 9 illustrates thetransportation matching system 104 utilizing an augmented realityenabled windshield, the transportation matching system 104 can utilizeany other transportation provider computing device (e.g., an augmentedreality wearable device for a transportation provider) to enable one ormore embodiments described herein on the transportation providercomputing device.

Additionally, the transportation matching system 104 can cause therequestor computing device to display augmented reality elements toidentify a transportation provider during an initialized transportationrequest. For example, FIG. 10 illustrates the transportation matchingsystem 104 causing the requestor computing device to display anaugmented reality element at the location of a transportation providervehicle within an environmental scene that includes the transportationprovider vehicle. For instance, as shown in FIG. 10, the transportationmatching system 104 can cause the requestor computing device 1010 todisplay an augmented reality element 1040 (e.g., a label stating “YourRide”) at the location of a transportation provider vehicle 1030 withinthe environmental scene 1020 that includes the transportation providervehicle 1030 (e.g., based on image recognition of the and/or thelocation of the transportation provider computing device). In someembodiments, the transportation matching system 104 can cause therequestor computing device to display an augmented reality element(e.g., an arrow and/or pointer), within an environmental scene, thatindicates (or points to) which direction the transportation providercomputing device (or transportation provider) is located regardless ofwhether the transportation provider is located within the environmentalscene or not located within the environmental scene.

Furthermore, although FIG. 10 illustrates (or describes) one or moreembodiments of the transportation matching system 104 within a mobiledevice, the transportation matching system 104 can similarly displayaugmented reality elements to indicate (or locate) the transportationprovider within an augmented reality wearable device (e.g., as describedin FIG. 5B) in accordance with one or more embodiments herein.

Turning now to FIG. 11, additional detail will be provided regardingcomponents and capabilities of one or more embodiments of thetransportation matching system 104. In particular, FIG. 11 illustratesthe transportation matching system 104 executed by a computing device1100 (e.g., a server and/or client device). As shown in FIG. 11, thecomputing device 1100 includes, as part of the transportation matchingsystem 104, a digital image stream generator 1102, a digital imageanalyzer 1104, an augmented reality element generator 1106, atransportation request generator 1108, and a storage manager 1110 whichincludes digital image data 1112, location data 1114, augmented realityelement data 1116, and transportation request data 1118.

As just mentioned, and as illustrated in FIG. 11, the computing device1100 includes the digital image stream generator 1102. For instance, thedigital image stream generator 1102 can receive and/or capture anenvironmental scene utilizing a camera of a requestor computing deviceand/or a transportation provider computing device as described in one ormore figures above (e.g., FIGS. 3 and 4). Moreover, the digital imagestream generator 1102 can provide one or more environmental digitalimages to determine information such as a requestor computing devicelocation and/or a transportation pickup location as described in one ormore figures above (e.g., FIGS. 3 and 4). In addition, the digital imagestream generator 1102 can provide, determine, and/or identify contextand/or a location for placement of one or more augmented realityelements in an environmental scene as described in one or more figuresabove (e.g., FIGS. 3-10).

Furthermore, as shown in FIG. 11, the computing device 1100 alsoincludes the digital image analyzer 1104. For example, the digital imageanalyzer 1104 can analyze one or more environmental digital images todetermine, identify, recognize, and/or detect a variety of informationincluding, but not limited to, a requestor computing device location, atransportation pickup location, a path between a requestor computingdevice location and a transportation pickup location, informationregarding an identified transportation provider, information regardingthe transportation request, and/or information regarding the completionof the transportation request as described in one or more figures above(e.g., FIG. 4). Additionally, the digital image analyzer 1104 canutilize approaches such as imagery SLAM to determine a variety ofinformation as described in one or more figures above (e.g., FIG. 4).

Moreover, as illustrated in FIG. 11, the computing device 1100 alsoincludes the augmented reality element generator 1106. For instance, theaugmented reality element generator 1106 can utilize an environmentaldigital image stream that is capturing an environmental scene andinformation such as, but not limited to, a requestor computing devicelocation, a transportation pickup location, a path between a requestorcomputing device location and a transportation pickup location,information regarding the identified transportation provider,information regarding the transportation request, and/or informationregarding the completion of the transportation request generate, create,display, and/or provide one or more augmented reality elements within anenvironmental scene as described in one or more figures above (e.g.,FIGS. 3-10). Furthermore, the augmented reality element generator 1106can display one or more augmented reality elements within anenvironmental scene on a variety of computing devices including, but notlimited to, a mobile device and/or an augmented reality wearable deviceas described in one or more figures above (e.g., FIGS. 3-10).

Additionally, as shown in FIG. 11, the computing device 1100 alsoincludes the transportation request generator 1108. For instance, thetransportation request generator 1108 can utilize information determinedfrom an environmental digital image to generate, send, and/or dispatch atransportation request to a transportation provider as described in oneor more figures above (e.g., FIGS. 4-10). Furthermore, thetransportation request generator 1108 can identify interactions with oneor more augmented reality elements and/or actions of a requestorutilizing a requestor computing device to generate, send, and/ordispatch a transportation request as described in one or more figuresabove (e.g., FIGS. 3-10). Furthermore, the transportation requestgenerator 1108 can utilize information such as, but not limited to, arequestor computing device location, information regardingtransportation pickup location, information regarding the identifiedtransportation provider, information regarding the transportationrequest, and/or information regarding the completion of thetransportation request to match, identify, determine, and/or dispatch atransportation provider for a transportation request as described in oneor more figures above (e.g., FIGS. 4-10).

Furthermore, as illustrated in FIG. 11, the computing device 1100 alsoincludes the storage manager 1110. The storage manager 1110 maintainsdata to perform the one or more functions of the transportation matchingsystem 104. As illustrated, the storage manager 1110 includes digitalimage data 1112 which can include environmental digital image streamdata captured from a requestor computing device, environmental digitalimages provided from the environmental digital image stream, and/ordigital image data utilized by one or more image recognition methods asdescribed in one or more figures above (e.g., FIGS. 3 and 4).Furthermore, the storage manager 1110 includes location data 1114 whichcan include location data for a requestor computing device, locationdata for a transportation provider computing device, location data for atransportation pickup location, and/or location data for a variety ofobjects identified in an environmental digital image, environmentaldigital image stream, and/or an environmental scene as described in oneor more figures above (e.g., FIGS. 3-10). Moreover, the storage manager1110 includes augmented reality element data 1116 which can includedigital images, information, and/or positioning information (e.g.,information corresponding to where an augmented reality element shouldbe positioned within an environmental scene) for a variety of objects(or information) such as transportation pickup locations, paths,guidance, and/or instructions as described in one or more figures above(e.g., FIGS. 3-10). In addition, the storage manager 1110 includestransportation request data 1118 which can include information such as,but not limited to, a destination location, a pickup location, requestorpreferences and a variety of information such as, but not limited to,information regarding transportation pickup location, informationregarding the identified transportation provider, information regardingthe transportation request, and/or information regarding the completionof the transportation request (e.g., an estimated time of arrival and/ora price) as described in one or more figures above (e.g., FIGS. 3-10).

Each of the components 1102-1118 of the computing device 1100 (e.g., thecomputing device 1100 implementing the transportation matching system104), as shown in FIG. 11, may be in communication with one anotherusing any suitable communication technologies. It will be recognizedthat although components 1102-1118 of the computing device 1100 areshown to be separate in FIG. 11, any of components 1102-1118 may becombined into fewer components, such as into a single facility ormodule, divided into more components, or configured into differentcomponents as may serve a particular embodiment.

The components 1102-1118 of the computing device 1100 can comprisesoftware, hardware, or both. For example, the components 1102-1118 cancomprise one or more instructions stored on a computer-readable storagemedium and executable by processors of one or more computing devices.When executed by the one or more processors, the computer-executableinstructions of the transportation matching system 104 (e.g., via thecomputing device 1100) can cause a client device and/or a server deviceto perform the methods described herein. Alternatively, the components1102-1118 and their corresponding elements can comprise hardware, suchas a special purpose processing device to perform a certain function orgroup of functions. Additionally, the components 1102-1118 can comprisea combination of computer-executable instructions and hardware.

Furthermore, the components 1102-1118 of the transportation matchingsystem 104 may, for example, be implemented as one or more operatingsystems, as one or more stand-alone applications, as one or more modulesof an application, as one or more plug-ins, as one or more libraryfunctions or functions that may be called by other applications, and/oras a cloud-computing model. Thus, the components 1102-1118 may beimplemented as a stand-alone application, such as a desktop or mobileapplication. Furthermore, the components 1102-1118 may be implemented asone or more web-based applications hosted on a remote server. Thecomponents 1102-1118 may also be implemented in a suite of mobile deviceapplications or “apps.”

FIGS. 1-11, the corresponding text, and the examples provide a number ofdifferent methods, systems, devices, and non-transitorycomputer-readable media of transportation matching system 104. Inaddition to the foregoing, one or more embodiments can also be describedin terms of flowcharts comprising acts for accomplishing a particularresult, as shown in FIG. 12. FIG. 12 may be performed with more or feweracts. Further, the acts may be performed in differing orders.Additionally, the acts described herein may be repeated or performed inparallel with one another or parallel with different instances of thesame or similar acts.

As mentioned, FIG. 12 illustrates a flowchart of a series of acts 1200for providing transportation pickup location information by utilizing anenvironmental digital image stream in accordance with one or moreembodiments. While FIG. 12 illustrates acts according to one embodiment,alternative embodiments may omit, add to, reorder, and/or modify any ofthe acts shown in FIG. 12. The acts of FIG. 12 can be performed as partof a method. Alternatively, a non-transitory computer-readable mediumcan comprise instructions that, when executed by one or more processors,cause a computing device to perform the acts of FIG. 12. In someembodiments, a system can perform the acts of FIG. 12.

As illustrated in FIG. 12, the series of acts 1200 includes an act 1210of capturing an environmental digital image stream. In particular, theact 1210 can include, capturing an environmental digital image streamutilizing a camera of a requestor computing device to initiate atransportation request. Furthermore, the act 1210 can include, inresponse to identifying an indication to initiate a transportationrequest at a requestor computing device, capturing an environmentaldigital image stream utilizing a camera of the requestor computingdevice. Moreover, the act 1210 can also include, in response toidentifying an indication to initiate the transportation request at therequestor computing device, displaying the environmental digital imagestream on the requestor computing device. Furthermore, the act 1210 caninclude providing an environmental digital image from the environmentaldigital image stream to a remote server. For instance, the requestorcomputing device can include a mobile device. Additionally, the act 1210can include, in response to identifying the indication to initiate thetransportation request at the mobile device, displaying theenvironmental digital image stream on the mobile device. Moreover, therequestor computing device can include an augmented reality wearabledevice.

As illustrated in FIG. 12, the series of acts 1200 includes an act 1220of determining a transportation pickup location based on a capturedenvironmental digital image stream. In particular, the act 1220 caninclude determining a location of the camera based on the capturedenvironmental digital image stream. Furthermore, the act 1220 caninclude determining at least one transportation pickup location based atleast in part on the location of the camera. Furthermore, the act 1220can include, determining the at least one transportation pickup locationby identifying one or more locations of one or more transportationproviders, determining a matched transportation provider from the one ormore transportation providers, and selecting the at least onetransportation pickup location based on a location of the matchedtransportation provider and the location of the camera.

Moreover, the act 1220 can include, in response to providing theenvironmental digital image, receiving a transportation pickup locationfrom the remote server based on the environmental digital image.Furthermore, the act 1220 can include, in response to providing theenvironmental digital image to the remote server, receiving a secondtransportation pickup location from the remote server based on theenvironmental digital image. Additionally, the act 1220 can includedetermining a second transportation pickup location based on theenvironmental digital image stream. Moreover, the act 1220 can include,in response to providing the environmental digital image, receiving aninitial requestor computing device location from the remote server basedon the environmental digital image.

As illustrated in FIG. 12, the series of acts 1200 includes an act 1230of providing, for display, an augmented reality element at thetransportation pickup location. In particular, the act 1230 can include,providing, for display on the requestor computing device, an augmentedreality element at the at least one transportation pickup locationwithin an environmental scene. For example, the augmented realityelement can include pickup information associated with each of the atleast one transportation pickup location. Moreover, the pickupinformation can include an estimated time of arrival and a costassociated with the transportation request (e.g., from each of the atleast one transportation pickup location). In addition, the act 1230 caninclude providing, for display on the requestor computing device, asecond augmented reality element at the second transportation pickuplocation within the environmental scene (and/or the augmented realityelement at the at least one transportation pickup location within theenvironmental scene). Moreover, the act 1230 can include displaying, onthe requestor computing device, the second augmented reality element atthe second transportation pickup location within the environmentalscene. Additionally, the act 1230 can include generating the augmentedreality element based on comparing information associated with the atleast one transportation pickup location and information associated witha second transportation pickup location.

Furthermore, the act 1230 can include providing, for display, on therequestor computing device, an augmented reality directional elementindicating a path to the at least one transportation pickup locationwithin the environmental scene. Moreover, the act 1230 can includedetermining an updated requestor computing device location based oninformation associated with the requestor computing device and theinitial requestor computing device location. Additionally, the act 1230can include, upon determining that the updated requestor computingdevice is within a threshold proximity to the at least onetransportation pickup location, sending the transportation request to atransportation provider.

Moreover, the act 1230 can include identifying an initial requestorcomputing device location based on the environmental digital imagestream. Furthermore, the act 1230 can include determining an updatedrequestor computing device location based on local movement informationassociated with the requestor computing device and the initial requestorcomputing device location. Additionally, the act 1230 can include, inresponse to determining that the updated requestor computing devicelocation is within a threshold proximity to the at least onetransportation pickup location, sending the transportation request to atransportation provider.

In addition, the augmented reality element at the at least onetransportation pickup location within the environmental scene caninclude a selectable element. Furthermore, the act 1230 can includereceiving an indication of an interaction with the selectable element.Moreover, the act 1230 can include, based on the indication of aninteraction with the selectable element, sending the transportationrequest, corresponding to the at least one transportation pickuplocation, to a transportation provider.

Embodiments of the present disclosure may comprise or utilize a specialpurpose or general-purpose computer including computer hardware, suchas, for example, one or more processors and system memory, as discussedin greater detail below. Embodiments within the scope of the presentdisclosure also include physical and other computer-readable media forcarrying or storing computer-executable instructions and/or datastructures. In particular, one or more of the processes described hereinmay be implemented at least in part as instructions embodied in anon-transitory computer-readable medium and executable by one or morecomputing devices (e.g., any of the media content access devicesdescribed herein). In general, a processor (e.g., a microprocessor)receives instructions, from a non-transitory computer-readable medium,(e.g., memory), and executes those instructions, thereby performing oneor more processes, including one or more of the processes describedherein.

Computer-readable media can be any available media that can be accessedby a general purpose or special purpose computer system.Computer-readable media that store computer-executable instructions arenon-transitory computer-readable storage media (devices).Computer-readable media that carry computer-executable instructions aretransmission media. Thus, by way of example, and not limitation,embodiments of the disclosure can comprise at least two distinctlydifferent kinds of computer-readable media: non-transitorycomputer-readable storage media (devices) and transmission media.

Non-transitory computer-readable storage media (devices) includes RAM,ROM, EEPROM, CD-ROM, solid state drives (“SSDs”) (e.g., based on RAM),Flash memory, phase-change memory (“PCM”), other types of memory, otheroptical disk storage, magnetic disk storage or other magnetic storagedevices, or any other medium which can be used to store desired programcode means in the form of computer-executable instructions or datastructures and which can be accessed by a general purpose or specialpurpose computer.

A “network” is defined as one or more data links that enable thetransport of electronic data between computer systems and/or modulesand/or other electronic devices. When information is transferred orprovided over a network or another communications connection (eitherhardwired, wireless, or a combination of hardwired or wireless) to acomputer, the computer properly views the connection as a transmissionmedium. Transmissions media can include a network and/or data linkswhich can be used to carry desired program code means in the form ofcomputer-executable instructions or data structures and which can beaccessed by a general purpose or special purpose computer. Combinationsof the above should also be included within the scope ofcomputer-readable media.

Further, upon reaching various computer system components, program codemeans in the form of computer-executable instructions or data structurescan be transferred automatically from transmission media tonon-transitory computer-readable storage media (devices) (or viceversa). For example, computer-executable instructions or data structuresreceived over a network or data link can be buffered in RAM within anetwork interface module (e.g., a “NIC”), and then eventuallytransferred to computer system RAM and/or to less volatile computerstorage media (devices) at a computer system. Thus, it should beunderstood that non-transitory computer-readable storage media (devices)can be included in computer system components that also (or evenprimarily) utilize transmission media.

Computer-executable instructions comprise, for example, instructions anddata which, when executed by a processor, cause a general-purposecomputer, special purpose computer, or special purpose processing deviceto perform a certain function or group of functions. In someembodiments, computer-executable instructions are executed by ageneral-purpose computer to turn the general-purpose computer into aspecial purpose computer implementing elements of the disclosure. Thecomputer-executable instructions may be, for example, binaries,intermediate format instructions such as assembly language, or evensource code. Although the subject matter has been described in languagespecific to structural features and/or methodological acts, it is to beunderstood that the subject matter defined in the appended claims is notnecessarily limited to the described features or acts described above.Rather, the described features and acts are disclosed as example formsof implementing the claims.

Those skilled in the art will appreciate that the disclosure may bepracticed in network computing environments with many types of computersystem configurations, including, personal computers, desktop computers,laptop computers, message processors, hand-held devices, multi-processorsystems, microprocessor-based or programmable consumer electronics,network PCs, minicomputers, mainframe computers, mobile telephones,PDAs, tablets, pagers, routers, switches, and the like. The disclosuremay also be practiced in distributed system environments where local andremote computer systems, which are linked (either by hardwired datalinks, wireless data links, or by a combination of hardwired andwireless data links) through a network, both perform tasks. In adistributed system environment, program modules may be located in bothlocal and remote memory storage devices.

Embodiments of the present disclosure can also be implemented in cloudcomputing environments. As used herein, the term “cloud computing”refers to a model for enabling on-demand network access to a shared poolof configurable computing resources. For example, cloud computing can beemployed in the marketplace to offer ubiquitous and convenient on-demandaccess to the shared pool of configurable computing resources. Theshared pool of configurable computing resources can be rapidlyprovisioned via virtualization and released with low management effortor service provider interaction, and then scaled accordingly.

A cloud-computing model can be composed of various characteristics suchas, for example, on-demand self-service, broad network access, resourcepooling, rapid elasticity, measured service, and so forth. Acloud-computing model can also expose various service models, such as,for example, Software as a Service (“SaaS”), Platform as a Service(“PaaS”), and Infrastructure as a Service (“IaaS”). A cloud-computingmodel can also be deployed using different deployment models such asprivate cloud, community cloud, public cloud, hybrid cloud, and soforth. In addition, as used herein, the term “cloud-computingenvironment” refers to an environment in which cloud computing isemployed.

FIG. 13 illustrates a block diagram of an example computing device 1300that may be configured to perform one or more of the processes describedabove. One will appreciate that one or more computing devices, such asthe computing device 1300 may represent the computing devices describedabove (e.g., computing device 1100, server device(s) 102, requestorcomputing devices 108, and transportation provider computing device112). In one or more embodiments, the computing device 1300 may be amobile device (e.g., a mobile telephone, a smartphone, a PDA, a tablet,a laptop, a camera, a tracker, a watch, a wearable device, an augmentedreality wearable device, an augmented reality display device, etc.). Insome embodiments, the computing device 1300 may be a non-mobile device(e.g., a desktop computer or another type of client device). Further,the computing device 1300 may be a server device that includescloud-based processing and storage capabilities.

As shown in FIG. 13, the computing device 1300 can include one or moreprocessor(s) 1302, memory 1304, a storage device 1306, input/outputinterfaces 1308 (or “I/O interfaces 1308”), and a communicationinterface 1310, which may be communicatively coupled by way of acommunication infrastructure (e.g., bus 1312). While the computingdevice 1300 is shown in FIG. 13, the components illustrated in FIG. 13are not intended to be limiting. Additional or alternative componentsmay be used in other embodiments. Furthermore, in certain embodiments,the computing device 1300 includes fewer components than those shown inFIG. 13. Components of the computing device 1300 shown in FIG. 13 willnow be described in additional detail.

In particular embodiments, the processor(s) 1302 includes hardware forexecuting instructions, such as those making up a computer program. Asan example, and not by way of limitation, to execute instructions, theprocessor(s) 1302 may retrieve (or fetch) the instructions from aninternal register, an internal cache, memory 1304, or a storage device1306 and decode and execute them.

The computing device 1300 includes memory 1304, which is coupled to theprocessor(s) 1302. The memory 1304 may be used for storing data,metadata, and programs for execution by the processor(s). The memory1304 may include one or more of volatile and non-volatile memories, suchas Random-Access Memory (“RAM”), Read-Only Memory (“ROM”), a solid-statedisk (“SSD”), Flash, Phase Change Memory (“PCM”), or other types of datastorage. The memory 1304 may be internal or distributed memory.

The computing device 1300 includes a storage device 1306 includesstorage for storing data or instructions. As an example, and not by wayof limitation, the storage device 1306 can include a non-transitorystorage medium described above. The storage device 1306 may include ahard disk drive (HDD), flash memory, a Universal Serial Bus (USB) driveor a combination these or other storage devices.

As shown, the computing device 1300 includes one or more I/O interfaces1308, which are provided to allow a user to provide input to (such asuser strokes), receive output from, and otherwise transfer data to andfrom the computing device 1300. These I/O interfaces 1308 may include amouse, keypad or a keyboard, a touch screen, camera, optical scanner,network interface, modem, other known I/O devices or a combination ofsuch I/O interfaces 1308. The touch screen may be activated with astylus or a finger.

The I/O interfaces 1308 may include one or more devices for presentingoutput to a user, including, but not limited to, a graphics engine, adisplay (e.g., a display screen), one or more output drivers (e.g.,display drivers), one or more audio speakers, and one or more audiodrivers. In certain embodiments, I/O interfaces 1308 are configured toprovide graphical data to a display for presentation to a user. Thegraphical data may be representative of one or more graphical userinterfaces and/or any other graphical content as may serve a particularimplementation.

The computing device 1300 can further include a communication interface1310. The communication interface 1310 can include hardware, software,or both. The communication interface 1310 provides one or moreinterfaces for communication (such as, for example, packet-basedcommunication) between the computing device and one or more othercomputing devices or one or more networks. As an example, and not by wayof limitation, communication interface 1310 may include a networkinterface controller (NIC) or network adapter for communicating with anEthernet or other wire-based network or a wireless NIC (WNIC) orwireless adapter for communicating with a wireless network, such as aWI-FI. The computing device 1300 can further include a bus 1312. The bus1312 can include hardware, software, or both that connects components ofcomputing device 1300 to each other.

FIG. 14 illustrates an example network environment 1400 of atransportation matching system (e.g., the transportation matching system104). The network environment 1400 includes a client device 1406, atransportation matching system 1402, and a vehicle subsystem 1408connected to each other by a network 1404. Although FIG. 14 illustratesa particular arrangement of the client device 1406, the transportationmatching system 1402, the vehicle subsystem 1408, and the network 1404,this disclosure contemplates any suitable arrangement of the clientdevice 1406, the transportation matching system 1402, the vehiclesubsystem 1408, and the network 1404. As an example, and not by way oflimitation, two or more of the client device 1406, the transportationmatching system 1402, and the vehicle subsystem 1408 communicatedirectly, bypassing the network 1404. As another example, two or more ofthe client device 1406, the transportation matching system 1402, and thevehicle subsystem 1408 may be physically or logically co-located witheach other in whole or in part. Moreover, although FIG. 14 illustrates aparticular number of the client devices 1406, the transportationmatching systems 1402, the vehicle subsystems 1408, and the networks1404, this disclosure contemplates any suitable number of the clientdevices 1406, the transportation matching systems 1402, the vehiclesubsystems 1408, and the networks 1404. As an example, and not by way oflimitation, the network environment 1400 may include multiple clientdevices 1406, the transportation matching systems 1402, the vehiclesubsystems 1408, and the networks 1404.

This disclosure contemplates any suitable network 1404. As an example,and not by way of limitation, one or more portions of the network 1404may include an ad hoc network, an intranet, an extranet, a virtualprivate network (VPN), a local area network (LAN), a wireless LAN(WLAN), a wide area network (WAN), a wireless WAN (WWAN), a metropolitanarea network (MAN), a portion of the Internet, a portion of the PublicSwitched Telephone Network (PSTN), a cellular telephone network, or acombination of two or more of these. The network 1404 may include one ormore networks 1404.

Links may connect the client device 1406, the transportation matchingsystem 1402, and the vehicle subsystem 1408 to the communication network1404 or to each other. This disclosure contemplates any suitable links.In particular embodiments, one or more links include one or morewireline (such as for example Digital Subscriber Line (DSL) or Data OverCable Service Interface Specification (DOCSIS), wireless (such as forexample Wi-Fi or Worldwide Interoperability for Microwave Access(WiMAX), or optical (such as for example Synchronous Optical Network(SONET) or Synchronous Digital Hierarchy (SDH) links. In particularembodiments, one or more links each include an ad hoc network, anintranet, an extranet, a VPN, a LAN, a WLAN, a WAN, a WWAN, a MAN, aportion of the Internet, a portion of the PSTN, a cellulartechnology-based network, a satellite communications technology-basednetwork, another link, or a combination of two or more such links. Linksneed not necessarily be the same throughout the network environment1400. One or more first links may differ in one or more respects fromone or more second links.

In particular embodiments, the client device 1406 may be an electronicdevice including hardware, software, or embedded logic components or acombination of two or more such components and capable of carrying outthe appropriate functionalities implemented or supported by the clientdevice 1406. As an example, and not by way of limitation, a clientdevice 1406 may include any of the computing devices discussed above inrelation to FIG. 13. A client device 1406 may enable a network user atthe client device 1406 to access a network. A client device 1406 mayenable its user to communicate with other users at other client systems1406.

In particular embodiments, the client device 1406 may include atransportation service application or a web browser, such as MICROSOFTINTERNET EXPLORER, GOOGLE CHROME or MOZILLA FIREFOX, and may have one ormore add-ons, plug-ins, or other extensions, such as TOOLBAR or YAHOOTOOLBAR. A user at the client device 1406 may enter a Uniform ResourceLocator (URL) or other address directing the web browser to a particularserver (such as server), and the web browser may generate a Hyper TextTransfer Protocol (HTTP) request and communicate the HTTP request toserver. The server may accept the HTTP request and communicate to clientdevice 1406 one or more Hyper Text Markup Language (HTML) filesresponsive to the HTTP request. The client device 1406 may render awebpage based on the HTML files from the server for presentation to theuser. This disclosure contemplates any suitable webpage files. As anexample, and not by way of limitation, webpages may render from HTMLfiles, Extensible Hyper Text Markup Language (XHTML) files, orExtensible Markup Language (XML) files, according to particular needs.Such pages may also execute scripts such as, for example and withoutlimitation, those written in JAVASCRIPT, JAVA, MICROSOFT SILVERLIGHT,combinations of markup language and scripts such as AJAX (AsynchronousJAVASCRIPT and XML), and the like. Herein, reference to a webpageencompasses one or more corresponding webpage files (which a browser mayuse to render the webpage) and vice versa, where appropriate.

In particular embodiments, the transportation matching system 1402 maybe a network-addressable computing system that can host a ride sharetransportation network. The transportation matching system 1402 maygenerate, store, receive, and send data, such as, for example,user-profile data, concept-profile data, text data, ride request data,GPS location data, provider data, requester data, vehicle data, or othersuitable data related to the ride share transportation network. This mayinclude authenticating the identity of providers and/or vehicles who areauthorized to provide ride services through the transportation matchingsystem 1402. In addition, the transportation service system may manageidentities of service requestors such as users/requesters. Inparticular, the transportation service system may maintain requesterdata such as driving/riding histories, personal data, or other user datain addition to navigation and/or traffic management services or otherlocation services (e.g., GPS services).

In particular embodiments, the transportation matching system 1402 maymanage ride matching services to connect a user/requester with a vehicleand/or provider. By managing the ride matching services, thetransportation matching system 1402 can manage the distribution andallocation of vehicle subsystem resources and user resources such as GPSlocation and availability indicators, as described herein.

The transportation matching system 1402 may be accessed by the othercomponents of the network environment 1400 either directly or vianetwork 1404. In particular embodiments, the transportation matchingsystem 1402 may include one or more servers. Each server may be aunitary server or a distributed server spanning multiple computers ormultiple datacenters. Servers may be of various types, such as, forexample and without limitation, web server, news server, mail server,message server, advertising server, file server, application server,exchange server, database server, proxy server, another server suitablefor performing functions or processes described herein, or anycombination thereof. In particular embodiments, each server may includehardware, software, or embedded logic components or a combination of twoor more such components for carrying out the appropriate functionalitiesimplemented or supported by server. In particular embodiments, thetransportation matching system 1402 may include one or more data stores.Data stores may be used to store various types of information. Inparticular embodiments, the information stored in data stores may beorganized according to specific data structures. In particularembodiments, each data store may be a relational, columnar, correlation,or other suitable database. Although this disclosure describes orillustrates particular types of databases, this disclosure contemplatesany suitable types of databases. Particular embodiments may provideinterfaces that enable a client device 1406, or a transportationmatching system 1402 to manage, retrieve, modify, add, or delete, theinformation stored in data store.

In particular embodiments, the transportation matching system 1402 mayprovide users with the ability to take actions on various types of itemsor objects, supported by the transportation matching system 1402. As anexample, and not by way of limitation, the items and objects may includeride share networks to which users of the transportation matching system1402 may belong, vehicles that users may request, location designators,computer-based applications that a user may use, transactions that allowusers to buy or sell items via the service, interactions withadvertisements that a user may perform, or other suitable items orobjects. A user may interact with anything that is capable of beingrepresented in the transportation matching system 1402 or by an externalsystem of a third-party system, which is separate from thetransportation matching system 1402 and coupled to the transportationmatching system 1402 via a network 1404.

In particular embodiments, the transportation matching system 1402 maybe capable of linking a variety of entities. As an example, and not byway of limitation, the transportation matching system 1402 may enableusers to interact with each other or other entities, or to allow usersto interact with these entities through an application programminginterfaces (API) or other communication channels.

In particular embodiments, the transportation matching system 1402 mayinclude a variety of servers, sub-systems, programs, modules, logs, anddata stores. In particular embodiments, the transportation matchingsystem 1402 may include one or more of the following: a web server,action logger, API-request server, relevance-and-ranking engine,content-object classifier, notification controller, action log,third-party-content-object-exposure log, inference module,authorization/privacy server, search module, advertisement-targetingmodule, user-interface module, user-profile store, connection store,third-party content store, or location store. The transportationmatching system 1402 may also include suitable components such asnetwork interfaces, security mechanisms, load balancers, failoverservers, management-and-network-operations consoles, other suitablecomponents, or any suitable combination thereof. In particularembodiments, the transportation matching system 1402 may include one ormore user-profile stores for storing user profiles. A user profile mayinclude, for example, biographic information, demographic information,behavioral information, social information, or other types ofdescriptive information, such as work experience, educational history,hobbies or preferences, interests, affinities, or location.

The web server may include a mail server or other messagingfunctionality for receiving and routing messages between thetransportation matching system 1402 and one or more client systems 1406.An action logger may be used to receive communications from a web serverabout a user's actions on or off the transportation matching system1402. In conjunction with the action log, a third-party-content-objectlog may be maintained of user exposures to third-party-content objects.A notification controller may provide information regarding contentobjects to a client device 1406. Information may be pushed to a clientdevice 1406 as notifications, or information may be pulled from theclient device 1406 responsive to a request received from the clientdevice 1406. Authorization servers may be used to enforce one or moreprivacy settings of the users of the transportation matching system1402. A privacy setting of a user determines how particular informationassociated with a user can be shared. The authorization server may allowusers to opt in to or opt out of having their actions logged by thetransportation matching system 1402 or shared with other systems, suchas, for example, by setting appropriate privacy settings.Third-party-content-object stores may be used to store content objectsreceived from third parties. Location stores may be used for storinglocation information received from the client systems 1406 associatedwith users.

In addition, the vehicle subsystem 1408 can include a human-operatedvehicle or an autonomous vehicle. A provider of a human-operated vehiclecan perform maneuvers to pick up, transport, and drop off one or morerequesters according to the embodiments described herein. In certainembodiments, the vehicle subsystem 1408 can include an autonomousvehicle—i.e., a vehicle that does not require a human operator. In theseembodiments, the vehicle subsystem 1408 can perform maneuvers,communicate, and otherwise function without the aid of a human provider,in accordance with available technology.

In particular embodiments, the vehicle subsystem 1408 may include one ormore sensors incorporated therein or associated thereto. For example,sensor(s) can be mounted on the top of the vehicle subsystem 1408 orelse can be located within the interior of the vehicle subsystem 1408.In certain embodiments, the sensor(s) can be located in multiple areasat once—i.e., split up throughout the vehicle subsystem 1408 so thatdifferent components of the sensor(s) can be placed in differentlocations in accordance with optimal operation of the sensor(s). Inthese embodiments, the sensor(s) can include a LIDAR sensor and aninertial measurement unit (IMU) including one or more accelerometers,one or more gyroscopes, and one or more magnetometers. The sensor suitecan additionally or alternatively include a wireless IMU (WIMU), one ormore cameras, one or more microphones, or other sensors or data inputdevices capable of receiving and/or recording information relating tonavigating a route to pick up, transport, and/or drop off a requester.

In particular embodiments, the vehicle subsystem 1408 may include acommunication device capable of communicating with the client device1406 and/or the transportation matching system 1402. For example, thevehicle subsystem 1408 can include an on-board computing devicecommunicatively linked to the network 1404 to transmit and receive datasuch as GPS location information, sensor-related information, requesterlocation information, or other relevant information.

In the foregoing specification, the invention has been described withreference to specific example embodiments thereof. Various embodimentsand aspects of the invention(s) are described with reference to detailsdiscussed herein, and the accompanying drawings illustrate the variousembodiments. The description above and drawings are illustrative of theinvention and are not to be construed as limiting the invention.Numerous specific details are described to provide a thoroughunderstanding of various embodiments of the present invention.

The present invention may be embodied in other specific forms withoutdeparting from its spirit or essential characteristics. The describedembodiments are to be considered in all respects only as illustrativeand not restrictive. For example, the methods described herein may beperformed with less or more steps/acts or the steps/acts may beperformed in differing orders. Additionally, the steps/acts describedherein may be repeated or performed in parallel to one another or inparallel to different instances of the same or similar steps/acts. Thescope of the invention is, therefore, indicated by the appended claimsrather than by the foregoing description. All changes that come withinthe meaning and range of equivalency of the claims are to be embracedwithin their scope.

What is claimed is:
 1. A computer-implemented method comprising:capturing an environmental digital image stream utilizing a camera of arequestor computing device to initiate a transportation request;determining a location of the camera based on the captured environmentaldigital image stream; determining at least one transportation pickuplocation based at least in part on the location of the camera; andproviding, for display on the requestor computing device, an augmentedreality element at the at least one transportation pickup locationwithin an environmental scene.
 2. The computer-implemented method ofclaim 1, wherein the augmented reality element comprises pickupinformation associated with each of the at least one transportationpickup location, wherein the pickup information comprises an estimatedtime of arrival and a cost associated with the transportation request.3. The computer-implemented method of claim 1, wherein determining theat least one transportation pickup location further comprises:identifying one or more locations of one or more transportationproviders; determining a matched transportation provider from the one ormore transportation providers; and selecting the at least onetransportation pickup location based on a location of the matchedtransportation provider and the location of the camera.
 4. Thecomputer-implemented method of claim 1, further comprising: determininga second transportation pickup location based on the environmentaldigital image stream; and displaying, on the requestor computing device,a second augmented reality element at the second transportation pickuplocation within the environmental scene.
 5. The computer-implementedmethod of claim 1, further comprising: identifying an initial requestorcomputing device location based on the environmental digital imagestream; determining an updated requestor computing device location basedon local movement information associated with the requestor computingdevice and the initial requestor computing device location; and inresponse to determining that the updated requestor computing devicelocation is within a threshold proximity to the at least onetransportation pickup location, sending the transportation request to atransportation provider.
 6. The computer-implemented method of claim 1,wherein the augmented reality element at the at least one transportationpickup location within the environmental scene comprises a selectableelement and further comprising: receiving an indication of aninteraction with the selectable element; and based on the indication ofthe interaction with the selectable element, sending the transportationrequest, corresponding to the at least one transportation pickuplocation, to a transportation provider.
 7. The computer-implementedmethod of claim 1, further comprising: in response to identifying anindication to initiate the transportation request at the requestorcomputing device, displaying the environmental digital image stream onthe requestor computing device.
 8. A non-transitory computer-readablemedium storing instructions that, when executed by at least oneprocessor, cause a computer system to: capture an environmental digitalimage stream utilizing a camera of a requestor computing device toinitiate a transportation request; determine a location of the camerabased on the captured environmental digital image stream; determine atleast one transportation pickup location based at least in part on thelocation of the camera; and provide, for display on the requestorcomputing device, an augmented reality element at the at least onetransportation pickup location within an environmental scene.
 9. Thenon-transitory computer-readable medium of claim 8, wherein theaugmented reality element comprises pickup information associated witheach of the at least one transportation pickup location, wherein thepickup information comprises an estimated time of arrival and a costassociated with the transportation request.
 10. The non-transitorycomputer-readable medium of claim 8, further comprising instructionsthat, when executed by the at least one processor, cause the computersystem to determine the at least one transportation pickup location by:identifying one or more locations of one or more transportationproviders; determining a matched transportation provider from the one ormore transportation providers; and selecting the at least onetransportation pickup location based on a location of the matchedtransportation provider and the location of the camera.
 11. Thenon-transitory computer-readable medium of claim 8, further comprisinginstructions that, when executed by the at least one processor, causethe computer system to: determine a second transportation pickuplocation based on the environmental digital image stream; and display,on the requestor computing device, a second augmented reality element atthe second transportation pickup location within the environmentalscene.
 12. The non-transitory computer-readable medium of claim 8,further comprising instructions that, when executed by the at least oneprocessor, cause the computer system to: identify an initial requestorcomputing device location based on the environmental digital imagestream; determine an updated requestor computing device location basedon local movement information associated with the requestor computingdevice and the initial requestor computing device location; and inresponse to determining that the updated requestor computing devicelocation is within a threshold proximity to the at least onetransportation pickup location, send the transportation request to atransportation provider.
 13. The non-transitory computer-readable mediumof claim 8, wherein the augmented reality element at the at least onetransportation pickup location within the environmental scene comprisesa selectable element and further comprising instructions that, whenexecuted by the at least one processor, cause the computer system to:receive an indication of an interaction with the selectable element; andbased on the indication of the interaction with the selectable element,send the transportation request, corresponding to the at least onetransportation pickup location, to a transportation provider.
 14. Thenon-transitory computer-readable medium of claim 8, further comprisinginstructions that, when executed by the at least one processor, causethe computer system to: in response to identifying an indication toinitiate the transportation request at the requestor computing device,display the environmental digital image stream on the requestorcomputing device.
 15. A system comprising: at least one processor; andat least one non-transitory computer-readable storage medium storinginstructions that, when executed by the at least one processor, causethe system to: capture an environmental digital image stream utilizing acamera of a requestor computing device to initiate a transportationrequest; determine a location of the camera based on the capturedenvironmental digital image stream; determine at least onetransportation pickup location based at least in part on the location ofthe camera; and provide, for display on the requestor computing device,an augmented reality element at the at least one transportation pickuplocation within an environmental scene.
 16. The system of claim 15,wherein the augmented reality element comprises pickup informationassociated with each of the at least one transportation pickup location,wherein the pickup information comprises an estimated time of arrivaland a cost associated with the transportation request.
 17. The system ofclaim 15, further comprising instructions that, when executed by the atleast one processor, cause the system to determine the at least onetransportation pickup location by: identifying one or more locations ofone or more of transportation providers; determining a matchedtransportation provider from the one or more transportation providers;and selecting the at least one transportation pickup location based on alocation of the matched transportation provider and the location of thecamera.
 18. The system of claim 15, further comprising instructionsthat, when executed by the at least one processor, cause the system to:determine a second transportation pickup location based on theenvironmental digital image stream; and display, on the requestorcomputing device, a second augmented reality element at the secondtransportation pickup location within the environmental scene.
 19. Thesystem of claim 15, further comprising instructions that, when executedby the at least one processor, cause the system to: identify an initialrequestor computing device location based on the environmental digitalimage stream; determine an updated requestor computing device locationbased on local movement information associated with the requestorcomputing device and the initial requestor computing device location;and in response to determining that the updated requestor computingdevice location is within a threshold proximity to the at least onetransportation pickup location, send the transportation request to atransportation provider.
 20. The system of claim 15, wherein theaugmented reality element at the at least one transportation pickuplocation within the environmental scene comprises a selectable elementand further comprising instructions that, when executed by the at leastone processor, cause the system to: receive an indication of aninteraction with the selectable element; and based on the indication ofthe interaction with the selectable element, send the transportationrequest, corresponding to the at least one transportation pickuplocation, to a transportation provider.